The Kenyan left Spurs in January for Montreal Impact, citing a lack of playing time.
"I was frustrated and when I came back from injury I didn't get enough chances to play and enjoy my football," he told The Athletic.
"When I came back, the club should have trusted me and given me more chances to play again.
"I was fit and training well. I never argued with Pochettino but I wanted to speak to him. I went to his office but he was busy. I saw his assistant Jesus [Perez].
"He told me be to be patient, that my chance would come blah, blah, blah. I didn't go to see them again. That's why I left the club. I'm a football player and I wanted to play football.
"I love Spurs, but I love playing football more."
Wanyama was a regular during most of his time at Spurs, but had injury issues when they reached the final last term.
But he was an unused substitute in the final when Spurs lost 2-0, which ended up being the last chance for former manager Mauricio Pochettion to win a trophy with the team.
He continued: "I was really, really p*ssed off not to start that game.
"And even more p*ssed off because we didn't win. I tried to encourage those who played.
"We went back to the hotel after the game. I couldn't sleep at all. The situation was going around in my head.
"He had to sit on the bench for the full game, so he could relate and understood what I was going through."