The Spurs centre-back, who turns 20 today, is ineligible to play for the Swans against his parent club.
"My aim is to keep Swansea in the Premier League but obviously I have been at Spurs for the last four or five years, so it's a difficult one," Caulker said.
"But I'm hoping for three points for Swansea. Spurs are a fantastic team with great depth in their squad and there is no reason why they can't go on and push for the title.
"It's a tough one for me because, if they do go on and win the title, I'm sure they will be looking to bring in new players.
"It's a catch-22 but I wish the boys all the best and hope they do as well as possible."