The London clubs were drawn to play against each other at the London Stadium in October after winning their way through the league cup's third round.
"Chelsea at home is a great game," Bilic said.
"Let's say that it's a very good thing for us is that we're playing at home and that it's a one-off tie.
"I'm expecting us to make improvements in the meantime. We have to earn a couple of good results and then the confidence will come back to us."