The Villains were beaten 2-1 at Stamford Bridge after Branislav Ivanovic headed home in the 73rd minute following Christian Benteke cancelling out Antonio Luna's earlier own-goal on the stroke of half-time.
Prior to the winning goal, Ivanovic was lucky not to be sent off after catching Benteke with a swinging arm whilst Villa could have been awarded a penalty in injury-time when John Terry appeared to handle the ball, prompting ire from Lambert.
"It's easy to sit here with sour grapes and all that sort of thing, (but) I thought my team were outstanding," he said.
"I don't think we deserved to lose the game. I think we've been done by two big decisions that were wrong.
"I don't think you can miss those ones, not big decisions like that. They're big game changers.
"My team never deserved that."
On the elbow on Benteke, he said: "I think it's an elbow. I know it's a physical game and all that, but I think it's an elbow."
And regarding the Terry handball, Lambert added: "It was a handball. It's there for everyone to see. (Gabriel) Agbonlahor's won the header and John Terry, good player, but you raise your hand in the penalty box, I think it's a penalty."