If City win the game it will be their 14th league victory in a row - a record in a single Premier League season.
"The record will be broken, my concern is how we win the game," he said.
"If you play one game thinking about records you forget what you have to do."
Guardiola also believes it is far too early to suggest that the match could be a title decider.
"Winning, drawing or losing on Sunday, we are not going to win or lose the Premier League. It's December," he added.
"There are a lot of points to play for, more than 70. We just focus on the game."