Agbonlohar insists he deserved longer to turn the club's form around with Steven Gerrard now installed as the club's manager.
“I think he deserved more time," he told website Football Insider.
“I actually felt this would happen when Spurs sacked Nuno Espirito Santo. They were five points ahead of us when they sacked him.
“I had a feeling the board would see that and then see where Villa are. The Southampton game was the last chance. If they had won that game, I think he would have been fine.
“Sometimes, clubs are too quick to panic. Dean Smith would have got the job done. He's been unlucky with injuries.
“I thought he had credit in the bank, it wasn't panic stations yet. If it was Christmas time and you were seven points adrift of 17th, I would understand.
“It was very harsh on Dean Smith. Everyday he'll be thinking 'I could've turned this around.
“There was a small section of Villa fans that were demanding he was sacked. They are quick to forget what he has done for the club. He brought them up with a record unbeaten run. Kept them up and then had a great season last season.
“When the going gets tough, fans are too quick to get rid of you. Fans want players to be loyal but some fans aren't loyal themselves to players.
“It's five games in a row lost. If you look at the games, they should have beaten Wolves for one. Before that, they beat Man United and Everton.
“I just feel sometimes with fans, it's got to work both ways."
Need a VPN? Or seeking to switch? Then support Tribal Football by clicking here to sign up with our official partners NordVPN. Not only will you receive the best VPN experience, but also great discounts by signing up via Tribal Football. Thanks for your support!