Luis Suarez deservedly levelled for the Reds and the visitors held on for a share of the spoils, despite captain Fabricio Coloccini seeing red for a rash lunge on the Uruguayan.
"It was a good point from a very hard and difficult away game," Cabaye told Newcastle's official website.
"In the first 10 minutes they put us under a lot of pressure but we stayed solid and they didn't have a really good chance to score.
"It was really important that we didn't concede early on because it meant we stayed in the game.
"After 20-25 minutes we kept the ball better, played in their half and had a few chances before my goal.
"Going in 1-0 up at half-time was great, but the goal we conceded in the second half we could have done much better with. However, a point here is a good point."