Kompany was distraught when he sliced a clearance straight to Philippe Coutinho, who then scored the Liverpool's winning goal.
“Obviously he is disappointed, everybody is,” said Milner.
“You can’t blame Vinny, everybody makes mistakes. Vinny has been outstanding for us. I’ve been at the club for four years and he’s been absolutely outstanding. “You can’t say anything like that because of the amount of times he’s saved us as well - it’s one of those things.
“We had the chance down at the other end to put it away and grab a draw but it wasn’t to be and now it’s not in our hands.
“We have to rely on a mistake and make sure we win our remaining games.”
For breaking stories and all the great banter like us on Facebook: facebook.com/tribalfootball