The Toon won 2-1 at Villa Park.
"I absolutely loved it," said Taylor. "For me, the feeling at the final whistle was the best I have ever experienced in a black-and-white shirt.
"We all had a big get-together on Monday night. The gaffer presented each of the new signings with a shirt and made them give a little speech and say why they wanted to be here.
"They were telling the lads, 'Listen, if you give us the chance, we'll prove to you that we want to be here'.
"It was in French, but translated into English for the boys. We listened to what they had to say and that was touching for us.
"They said they wanted to be accepted into the team and promised they would give 100 per cent. That was exactly what we wanted to hear.
"Some of the players got the French boys to sing in front of all of us. That got the banter going, welcome to the group. We're up for the fight and that's what it was about at Villa."