They still lie in fourth, however, one place above Manchester United and the optimism will soon return if this week goes well.
But midfielder Milner admitted: "We'd like to have a few more points. In the first game we played really well, setting our standards high, and since then we haven't quite hit those, for whatever reason.
"Now the first game in Champions League is important and then there's the derby next week, so it's a big few weeks for us."
For the big stories and the banter follow us on Twitter: @tribalfootball