Demba Ba's curling opener from the corner of the box in the 55th minute lit up a tough but low-key encounter and sparked the late drama in which Jermain Defoe bundled a 76th minute equaliser and Hatem Ben Arfa slotted a penalty winner four minutes later.
The excitement was too much for Pardew, who despite urging his players to keep their cool in his programme notes, lost his own when confronting the linesman over a touchline incident and was sent to the stands.
Pardew said: "There's me telling my players to behave themselves and follow the Olympic spirit and be humble, and they did it except for me.
"It was a stupid moment - the linesman just happened to be standing right in front of me when I thought the ball was out, and I gave him a little shove. I have apologised and I can't turn the clock back, so I will have to take my punishment."