He told The Sun: "People can boo all they want. As long as it's not filth or racist chanting, I don't really care what they sing.
"These type of people are too busy chanting that they probably don't know what is happening on the pitch. I've had stick in the past and I'll get it again in the future, it's part of the game.
"I'd never say it was like water off a duck's back though because no one likes getting stick, no matter what the circumstances. I could understand if fans dished it out if I'd taken the club down through the divisions, but the exact opposite happened.
"Look where Portsmouth were when I arrived and where they were when I left. An improvement? I'd certainly say so. I honestly believed that when I turned down the chance to manage Newcastle that Portsmouth would be my last stop in football before I retired.
"But when Tottenham came in for me it was so difficult as I'd heard all the stuff about me not being able to do this job at a big club, that I only wanted to work in the comfort zone.
"I discussed the move to Spurs with everybody and it's far from being in the comfort zone here because it is a massive rebuilding task.
"But I believe changing clubs worked out really well for all those involved.
"Portsmouth got £5million in compensation, I left behind a squad that won the FA Cup and were seventh in the league. I don't know what else I could have done. When I first went there, the club were used to finishing 17th, 18th or 20th - and I don't mean in the Premier League, I mean in the Championship.
"Without any disrespect, in years past it would have been Brighton or Bournemouth. I gave the fans what they craved. Five of that squad were named as England internationals - David James, Sol Campbell, Glen Johnson, Jermain Defoe and Peter Crouch.
"Before that you would have to go back to the time centre-forward Tony Hateley was wearing Portsmouth colours."