The England international has made three substitute appearances for Jurgen Klopp's side, but it was his first start for them at King Power Stadium.
"Disappointing," Heskey said on Sky Sports about his performance.
"Sometimes you forgot he was even playing in the game.
"You expect him to be all-action up and down that wing and we didn't see it.
"Creating chances, running at the defence.
"In all fairness, I've got to give it to Ben Chilwell because he played a blinding game today."