Joe Willock struck on 95 minutes to earn Newcastle a draw at Anfield.
Afterwards, Klopp said: "We scored a wonderful goal, didn't finish the game off. Didn't play enough. A counter attack can happen but we had to just keep going, keep the ball and make them run. We kept them alive and they deserved the goal. They scored the one before, unlucky for Wilson but it is handball. We don't even take this present. Really tough to take.
"Why it happened, I don't know. We had to keep the ball. In a specific way we don't fight enough. Keep ourselves in a position where we dominant the game. We had 70% of the ball, we should have 80%. We created a lot of chances, didn't score with them, so we have to create more. That is how it is. We don't do that well at the moment.
"They fought for it and we got nothing pretty much, but a point. It feels like a defeat.
"If you deserve, you deserve it. I didn't see us deserve it today playing Champions League next year."