Shola Ameobi struck nine minutes from time to claim just the Magpies' second Barclays Premier League win in eight attempts with the game seemingly heading for stalemate.
Pardew said: "The pudding will taste a little bit sweeter. I feel sorry for our fans. We have put them through the rack, really, over this last period.
"They have watched some football that hasn't been our best. But you have periods in your tenure as a manager and sometimes a season.
"Last season, we sailed through one or two low moments but not many. This year, it's been a sustained little run.
"But the last five games, two wins in the last four Premier League games, they are starting to look the right sort of stats now.
"Now we need to back that up and get a big win against one of the big clubs, and that would really cement us into mid-table."