While Hodgson has done an admirable job in keeping the club in the Premier League, fans are upset with the defensive play-style.
They believe the club should look to play attacking football and pick up points, not prioritise one over the other.
But Hodgson believes things can get a lot worse very quickly.
"I do think it is difficult and important for clubs," said Hodgso, per the Evening Standard. "People need to be careful.
"When Alan Curbishley left Charlton many years ago, they were constantly in the top half of the table, it was because fans were not happy and thought that finishing in the top half of the Premiership wasn't enough and that they needed to kick on.
"They did, they kicked downwards and that is the only problem. You have to be careful.
"This is part and parcel of our football life.
"As a manager and coach or player you're going to be criticised for performances and people are going to read into things from performances that are not always there. As owners, you're also going to face a lot of criticism from time to time.
"The so-called 'lack of ambition', whatever that happens to be - it covers a multitude of sins. These are topics and issues that are going to be raised every time you have a spell which is not living up to people's expectations or hopes really."