The incident went unnoticed by referee Andre Mariner - with Son Heung-min equalising from the resulting counter-attack.
But Guardiola was in complementary mood to Mauricio Pochettino's side, while ruing his team's missed chances and having a slight dig at the match officials.
He told BT Sport: "They know when they play well because they were aggressive, but I would like to say we played well with and without the ball.
"Tottenham are by far the best when you let them play, when you let them play they are the best team in the league. They have a lot of quality in midfield players, attacking midfielders, wingers, the strikers - they are an outstanding team.
"So when we were able to play better than them today, I am so satisfied. I am of course sad because the players do not deserve that but in the future this performance will make us stronger.
"We played really good but we missed a lot of chances and when that happens you cannot win.
"It was deja vu. Again, (as) what has happened for the rest of the season - we create more, we concede a few, and the referees are always against (us).
"We are not going to achieve big targets this season. We are going to try and keep going and going but we create too much and we get nothing. We drew because we missed a lot of chances, the same at (the losses against) Everton and Chelsea.
"We played against Tottenham and Tottenham are a top, top, top, top team and when you make these chances then the referee doesn't matter."
On the penalty incident, the Spaniard said: "He said that he pushed him. So thank you Kyle Walker for being honest. So I appreciate."
Need a VPN? Or seeking to switch? Then support Tribal Football by clicking here to sign up with our official partners NordVPN. Not only will you receive the best VPN experience, but also great discounts by signing up via Tribal Football. Thanks for your support!