Georginio Rutter struck late on to earn a point for the visitors.
Reflecting on Saturday's performance, Carragher told Sky Sports: "We're talking about time, we're talking about the 94th minute. Djed Spence who has come on in the 76th minute, now, he's done well he's closed down.
"He can't pull out (of the press) he's got to keep going and he's unlucky. But Djed Spence, I don't like this. You've got to sprint back.
"He's walking. He was a sub. He's only been on 15 minutes. Then you've got you two young midfield players, we highlighted them in the Sunderland game, they didn't start this game.
"But they understand football, they're clever those two young lads (Bergvall and Gray). They know somebody has got to fill in at left-back.
"The left-back is now here (Spence is up the pitch). They look to fill in. Now, the situation here, Porro leaves his man, but Paulinha now ends up at right-back.
"We're going to keep an eye on Djed Spence here, it comes into Danso and everyone is talking about his mistake, but he (Spence) starts walking, then walks again because he thinks Danso has got the ball.
"Your two midfield players are filling in for him at left-back, leaving their slot in midfield and that's where Rutter scores the goal. Brilliant finish on that left foot, but it's an absolute body blow for them.
"You can see the reaction from them, but listen there was a lot of positives to take from it for Tottenham in terms of how they went about it and how they played. (De Zerbi) won't feel that right now."