Spurs are likely to miss the top four this season.
"No, I don't think finishing outside of the top four can be called a failure," he told Sky Sports.
"People forget we have only finished in the top four once after a very long time [back in 2009/10], but I do think it will be disappointing if we don't.
"Our fans will not have a good summer. As players, it will not be cool and I know the boss will not like it, so nobody will be jumping and laughing.
"But nobody will be crying because we are not getting relegated, and we are still one of the top sides in the country."