The 22-year old has been the subject of speculation linking him with a move away from Old Trafford, with Roma listed as an interested party.
But Silvestre thinks more time should be given to his compatriot now that Zlatan Ibrahimovic has left.
Silvestre said: "Zlatan's aura was big. So was his character, his ego, and what he was spreading around him was sometimes intimidating for the younger players.
"It also gives you an example to follow, so it was good to have him around. But for the younger players and Anthony, you'd expect them to score more goals."
"When you reach that level and then you have a difficult time, you bounce back, because you are a competitor.
"Anthony has reached the level of Manchester United and the French national team, so I think he will answer the critics and improve his game to perform at least as the same level as his first season."