The Blues have taken only two points from their last four league games to leave Di Matteo rueing another bleak November for Chelsea.
Di Matteo said: "It is a ground we find difficult, last season when we lost here, and now this season again. We know they are very good at home.
"But giving away goals like we did today makes if difficult to win the game.
"You have to score three goals to win then and our defending was very poor today.
"We didn't concede many chances but, the ones we did, we had to do better."