Tote says the decision to dump Xabi as Real coach has already been made.
He told Radio Marca: "I have the feeling that Xabi's time is up, because there's no confidence in him and some people don't believe in him.
"He's fighting for his job every three days, and working like that must be incredibly difficult.
"When you arrive at a monster like Real Madrid, you have to have a lot of personality to lead and establish your authority."
Tote added: “What happened with Vinicius (Junior) really disappointed me. There had to be a punishment to send a message to the group.
“Up front they have the best player and in goal they also have the best player, and those two are holding the team together."
Real Madrid are at Tavalera tonight in the Copa del Rey round of 32.