Nelsen, who played for Spurs in Harry Redknapp's final six months at the helm, lavished praise on Defoe during an interview this week, admitting he would be an "unbelievable" signing for the Canadian club.
Villas-Boas says he is not concerned at Nelsen's revelation that he regularly speaks to his former Tottenham team-mate.
"I'm fine with this," the Portuguese said.
"I have no problem (with it). In the end situations like this can happen."
For the big stories and the banter follow us on Twitter: @tribalfootball