Klopp signed Loris Karius from Mainz in the summer to compete with Simon Mignolet but the Belgian has been enjoying an unchallenged spot in the starting eleven in the early parts of the season due to Karius' hand injury.
The German keeper is set to make his Reds debut in Tuesday's League Cup game against Derby County but Klopp does not want this to kickstart a perceived battle between the pair.
Klopp said: "Simon [Mignolet] came exactly in this moment back from the national team and did a brilliant job.
"I don't want to make a big battle of these two goalkeepers, why should I?
"Goalkeepers need to feel secure. You cannot play your whole life as a goalkeeper without conceding goals… but you need a manager who will say 'you can stay' and increase their confidence. That's the same with all players. It's not about saying 'today him, and today him', it's about watching the players.
"The pressure on them is big enough - I don't have to make any more. They have to do their best and if, at the end, I have a feeling for something then I will change or not.
"But it's not because we paid money for Loris and didn't pay money last year for Simon and that makes the decision.
"It's about what I see in training and what I see in training is two very, very good goalkeepers and another very good goalkeeper [Danny Ward] who we gave on loan to Huddersfield.
"So the business is done, hopefully, and we don't have to talk about this position. Now the boys have to perform."