Antonio Conte's men suffered their second defeat in a row when they lost 4-1 to Watford on Monday night. Reports suggested Conte has one foot out the door after the loss, with his firing predicted to be imminent.
However, Wilkins has put the blame on the players, who he says performed in the same way before Jose Mourinho was sacked in 2015.
"We can say it's the manager's fault, but he doesn't go out there and play.
"They've switched off. Some of the goals Chelsea conceded were absolutely abysmal.
"If your dressing room is not manned up, you've got massive problems.
"I don't see the blokes in that dressing room I've got to say. As much as people say it's time for a change at the top, I think they've got to clear out a lot of players at that club."