The result moves Villa into tenth on the table, ahead of the Foxes on goal difference.
And the Zambia striker repaid his manager by setting up Harvey Barnes for the opening goal after 14 minutes.
Ezri Konsa levelled for Villa three minutes later after poking home Matty Cash's header.
The home side thought they went ahead before half-time but the goal was disallowed because Kasper Schmeichel had one hand on the ball when Jacob Ramsey struck it into the net.
It didn't matter however as Leicester's set-piece shortcomings were punished once again when Konsa nodded home John McGinn's early in the second-half.
Speaking after the game, Gerrard hailed his players for not letting their heads drop after going behind early on.
"I don't want us to be a team that looks back and feels sorry for ourselves," he said.
"It's important that we're positive and move forward. This a huge win; it puts us into the top ten and now we really want to look forward.
"We've got Wolves and Brighton in our sights and we want to keep pushing forward."
Need a VPN? Or seeking to switch? Then support Tribal Football by clicking here to sign up with our official partners NordVPN. Not only will you receive the best VPN experience, but also great discounts by signing up via Tribal Football. Thanks for your support!