The Blues sit on top of Group G in the Champions League with 10 points, level with Porto, who they host at Stamford Bridge.
While a point would safely see Chelsea through, even if Dynamo Kyiv defeat Maccabi Tel Aviv, Courtois says it is important for the out-of-form Premier League champions to produce a winning display.
"We will play to win," said the Belgian goalkeeper.
"If you play just to draw, you never know what can happen in the last minute.
"Every footballer wants to win their games and it will be the same tomorrow. We want to give our fans a victory, because this season we've lost too many games at home and it shouldn't be like that.
"All the players have to improve our level. We are a team but sometimes individually we haven't been at our best. If everybody gets to their top level, we will start winning games."