Spurs required an 80th minute Roberto Soldado penalty to beat Hull City 1-0 on Sunday which saw some sections of the crowd grow increasingly frustrated as the match progressed.
But in-form winger Townsend believes the White Hart Lane faithful needs to show more patience when the team is trying to overcome lesser opponents.
"I'm not going to sit here and criticise the Spurs fans, especially because they've been great with me but understand it is hard for us. We try and play good football and I think Hull set out in a 4-5-1 formation and came to defend,” he told talkSPORT.
"It took 80-odd minutes for us to break them down and, in the end, we got the three points we deserved and that's all that matters.
"West Ham did that and ended up beating us 3-0 (in early October). The main thing was not to get too frustrated, not to go too gung-ho too early, keep playing our normal football and just hope we can break them down before the 90 minutes.
“I think we learned our lessons and we got the three points against Hull."
For the big stories and the banter follow us on Twitter: @tribalfootball