Toon played much of the game with ten men after Cheick Tiote's first-half dismissal.
Cabaye said: "Playing one hour with 10 men on the pitch in a derby is difficult.
"The referee decided to send off Cheick, but afterwards, we stayed compact and we fought as a unit, as a team.
"Unfortunately for us, they scored with five minutes to go. We were a bit disappointed, but with 10 men on the pitch, it was a good result for us."