Pulis' side may have been in a respectable-looking 13th place ahead of the game but the loss left them just point above Villa.
Their goal was only their second in six games, boos were often heard from the crowd and pressure is growing on Pulis.
Pulis said: "I think when things go against you they go against you and at the moment things are going against us.
"In life when things are going well and everyone is happy it all rolls and doesn't take any character to roll with the good times.
"When the bad times come you have got to show your character and that is what we have got to do as a group - everyone at the football club.
"Everyone has got to stick together and make sure we get the six points to stay up."