The Potters' defeat to Aston Villa leaves them three points away from the dropzone.
"The first two seasons here were very difficult," said Pulis.
"I've been in it before and the first season I was here, in the Championship, we stayed up in the last game of the season against Reading. We have to look after ourselves. We have to keep working hard and believe. That was only the third home game we've lost all season.
"The disappointing thing it was West Ham and Villa that have beaten us here at the back end of the season. The rest of the time we've looked really good at home. But this result is a big kick-in-the-teeth for everyone connected with the club.
"I might not have been relegated as a manager but that's in the past. We need to look forward and get the players' confidence together."