Leonardo Bonucci's error gave away the opener, then Juve had fought back to lead 2-1 only for another defensive howler 60 seconds later.
Conte said: "It was certainly disappointing, as we had managed to put the game back on track after an incident, which can happen. It's a shame, as if you score at the 87th minute and then concede straight from the kick-off it is unusual.
"We have to be more attentive and clear-headed. The lads had tried so hard to get back into the match and I believe we achieved that in a deserved fashion.
Now it's an uphill struggle, but we must not get downhearted. We've got to fight with the dagger between our teeth. If we do well then we will go forward, if we don't then it'll mean the others were better and we tip our hats to them."
For breaking stories and all the great banter like us on Facebook: facebook.com/tribalfootball