Klopp felt that United deserved to get a point after the game after not only fighting back once but also shrugging off the controversial VAR decision that left fans fuming.
Speaking after the 1-1 draw, Klopp said: "Very tough to take but there is nobody else to blame but ourselves.
"When you create chances like we created today and you don't use them then you keep the game open.
"That's what we did, but again, that's football – the oldest and most important football rule [is] you better use your chances when you have them because they will come back again.
"That's what we didn't do and that's why in the end Newcastle deserve a point because they scored a goal that was disallowed and as far as I remember it was the first time we were lucky with VAR, to be honest, but we didn't even take that present.
"We gave them another one, they used that, so it's a 1-1."