He said: "I've seen my name a couple of times linked with it but I just view that as a reflection on the job myself and the staff are doing here, and the players are doing."
He added: "My interest is solely in Blackburn Rovers."
Hughes believes Spurs have already decided on their next manager, with Sevilla boss Juande Ramos reportedly their top target.
"I would suggest any appointment that's to be made is obviously in place," Hughes said.
Ironically, Blackburn's next game is at White Hart Lane on Sunday, and Hughes acknowledged the speculation was poorly timed from his point of view.
"It's an inconvenience when you're going up against the team that you're supposedly linked with," he said.
"You can do without that."