Neville, 32, is now on his way back to fitness having not played since March.
But while Richards has the utmost respect for Neville he does not believe he should lose his England place.
Richards, 19, said: "I have got seven caps now and I think I have performed well in all seven games.
"It is up to the manager who he wants to pick and I will respect his decision.
"Gary is a legend. He gets a bit of stick but you cannot dispute what he has done.
"But I hope that when he is fit I do get back in."