Pardew was critical of his side's defending at Craven Cottage.
"It's a really soft second goal - a soft free-kick, soft defending on the free-kick and you can't do that at this level because we had the game by the scruff of the neck at this point," said Pardew.
"We played some of our best attacking football of the season, but we've still come away with nothing. Performances don't get you points.
"In the second half we were terrific other than those two or three moments. We've got no-one to blame but ourselves."
"I think we've conceded poor goals at crucial times and away from home it's costly."
Newcastle's next game is at home to defending champions Manchester City but Pardew believes his side can still challenge the top sides at St James' Park.
"I think at home we are a threat to anybody," he added.