The Portuguese was removed from his post as Spurs boss on Monday in the wake of Sunday's 5-0 loss to Liverpool but Wednesday night's Capital One Cup opponents believe it was a rash call.
Allardyce suggests Villas-Boas should have been given more time to get a brand new group of players together especially after the north London club spent so much money on new faces in the summer.
"When you are in a transition period of that nature and that size, with so many new faces, it is virtually impossible to get consistency and arrive at what the expectation is," Allardyce said.
"Decisions made as quickly as that are a surprise because of the situation Tottenham were in at the start of the season, bringing so many new players in.
"To get the team playing together as a team and understanding each other in such a short period of time is nearly impossible. The fruition of the change around at Tottenham starts more next season.
"You would have to be a miracle worker to get everyone functioning to the best of their ability when they have just arrived from a foreign country into a different culture that they have never played in before."
For breaking stories and all the great banter like us on Facebook: facebook.com/tribalfootball