The Hoops were beaten 2-0 by the Kazakhstanis in Astana on Tuesday night but van Dijk feels that a trip to Glasgow will be difficult for the visitors and is backing he and his Celtic teammates into a victory.
"At Celtic Park, anything can happen and we're definitely still in it. We have the fans behind us and that's the biggest thing for us. It's not over," the Dutchman said.
"We created a lot of chances in the first game and had a lot of the ball, but now we have to make sure we do the job at Celtic Park."
He added: "We need to keep believing. Every supporter always stands behind us, and I'm sure that's going to be the case on Wednesday."