The United boss was in the stands serving the seventh and final match of the touchline ban incurred following his headbutt on Hull City’s David Meyler.
Swansea’s match-winner arrived in stoppage time when Wilfried Bony, having earlier cancelled out Shola Ameobi’s opener, netted from the penalty spot after Marvin Emnes had been fouled by Cheik Tiote.
But Pardew believes the break which led to the concession of the spot-kick would never had happened had he not been in the directors box.
"I was sitting with the analyst in the last 10 minutes and you think your presence on the sideline might have influenced that situation," he said.
"I would have prevented that goal if I’d been on the touchline.
"So I will be pleased to be back on the sideline against Arsenal (next Monday), for sure."
For breaking stories and all the great banter like us on Facebook: facebook.com/tribalfootball