City are within three points of league leaders Chelsea but have two games in hand giving them the advantage ahead of the season run-in.
The 2012 champions beat neighbours Manchester United 3-0 on Tuesday night but Kompany was not getting too carried away as the Citizens look to secure a second premiership in three seasons.
"It's just one little step [beating United]," Kompany told Sky Sports in the wake of the United win. "The other teams are still very good.
"I mean, games have to be played. As long as we don't have the points, I don't consider ourselves there yet.
"With the game against Arsenal (at the Emirates this Saturday), obviously it's good in a way because you don't have to make a big effort to get the lads focused again."
For breaking stories and all the great banter like us on Facebook: facebook.com/tribalfootball