Cabaye later apologised for his part in the incident which saw Cahill dismissed.
He said: "I would like to apologise for the cross words I exchanged with Tim Cahill which resulted in his red card and my booking on the final whistle.
"It was unnecessary and, regrettably, the result of frustration and disappointment, all in the heat of the moment. It is out of character and for that I am sorry.
"We have had a fantastic season at Newcastle United and already I look forward to next season, the Premier League and the Europa League.
"Finally, a huge thank you to our fans who have been magnificent all season."