City still have a five-point lead at the top of the Premier League and their rivals will be hoping the Napoli defeat will be the start of a slump.
But Milner, 25, declared: "We're not really worried about what other teams are thinking.
"We've got some big games coming up and it's going to be massive on Sunday.
"That's the pleasing thing — and we've got games every few days.
"We don't have an international break to think about the defeat, we're straight back at it and hopefully we can bounce back with a victory."