The Saints centre-back felt he was unfairly blamed by fans and the media for a number of goals conceded in the opening games of the campaign.
"People were saying it was poor, it was bad and they had to blame someone. Oh, and that is me.
"We're now over that and it's not like I am amazing now and before I was terrible.
"We didn't have much experience in the Premier League so it was a bit annoying when it was 'Jos this', 'Jos that'.
"I was a bit unfortunate with own goals, penalties or whatever. It was a thin line. Sometimes you are the praised man and at the beginning of the season I was the fall guy. I took the blame for everything.
"It bothered me a little bit when people pointed the finger at my direction. The media, the fans were questioning me. If one shouts, everyone follows. If a journalist writes an article, about 80 per cent of the people will not question it.
"If one guy is in the pub shouts and 'Hooiveld is terrible' there is never a guy that comes and debates it, they join in."