Palace defeated Spurs 1-0 in the fifth round of the FA Cup at White Hart Lane on Sunday thanks to a first-half strike from Martin Kelly.
Vorm, who was standing-in for an injured Hugo Lloris, was beaten by the Palace full-back's effort at his near post but Pochettino was not prepared to lay the accountability on the Dutchman.
"If you analyse it, it was a collective mistake," said Pochettino.
"If you analyse the action I think he [Vorm] is the last player that you blame.
"Football is about mistakes - when you score it's because an opponent made a mistake and when you concede a goal it's because you made a mistake.
"If not all the games would be 0-0."