The Sun says Given, 36, has lost his place in the Villa side to Brad Guzan.
The Irishman was with the Bhoys as a teenager but never played a first-team game.
Given said: "I would love to play for Celtic.
"I don't know if that will be possible in the future and I am a Villa player now. Maybe that could change."