England are suffering their worst run at Wembley for 30 years having failed to win their last four matches.
But Milner insisted: "I don't think we are really thinking about that too much. We go into every game to win it.
"We know on our day we can beat anybody. The squad is changing a bit and improving as well but at Wembley we need to make sure we get the wins."