For Newcastle it was the worst possible start to the season, with influential midfielder Yohan Cabaye now the subject of interest from Arsenal and Taylor facing a three-match ban after an inexplicable loss of temper.
"The sending off was completely out of character for Steven and he has apologised," said Magpies manager Alan Pardew.
"I can't really say anymore except that he is an honest player who made a mistake and we had to suffer the penalty for that.
"After the sending off we were digging in, and the spirit and the commitment the guys showed I was quite proud of them in the second half."
For the big stories and the banter follow us on Twitter: @tribalfootball