Milner was playing against the club who handed him a league debut in 2002.
He told ESPN: "I hadn't played against them before but once you get on the field it's just another game. It was a good atmosphere and a good result for us in the end.
"It was important we bounced back, they've knocked a few Premier League teams out of cups this season so it was important we did a job and we did it well.
"We had to improve on last week, we did that, we kept a clean sheet and scored four goals so that's pleasing."