The loss forced Newcastle down to 14th on the table but Pardew felt it was an undeserved result for his side, especially as they were denied a penalty after Cisse's opener.
"The improvement from Sunday was immense and we deserved to get something from today and we certainly didn't deserve to get beat that's for sure, we were the better side," Pardew told Sky Sports.
"There is a crucial moment in the game at 1-0 where I thought we had a handball and I just looked again and I think it is a penalty and then two sucker punches really and we have got beat," he said. "Their keeper has made two good saves, and it is galling really as we are on this run and we are having setback after setback and I feel sorry for the players today as they were brilliant, sometimes you don't get what you deserve and we certainly didn't today.
"We made a couple of errors in those goals and that has cost us. We do not make many errors but we have tonight."