Redknapp was in charge of the Saints when they were relegated from the Premier League in 2005, before leaving to take over bitter rivals Portsmouth.
"Listen, I will get a bit of grief, won't I? But what can you do? That's no problem," said Redknapp.
"I wouldn't say Southampton supporters are nasty, aggressive people. They're not.
"They're good supporters and they'll give me a bit of grief but that's life. I accept that. I will just get on with it.
"I won't lose any sleep over that. I will only lose sleep if the result is bad."