Oliver did not give either decision but, while frustrated, Warnock believes QPR can be proud of their performance.
"When I was a young man, my father was a referee and he always said that a 'good referee you don't very often see'," he said. "I thought in today's game the two main decisions went against us.
"When not one Aston Villa supporter behind the goal appeals for a penalty you know there is something wrong. It is a very soft one. From his position he assures me he saw this and technically you've still got to change the course of the play.
"You could have blown him down with the amount of contact you're actually talking about. If he gives that, there have got to be 20 or 30 more [decisions given] in the box every game because there is a lot more pulling than that.
"Likewise, I thought he was in a good position for the first handball on 70-odd minutes. The lad actually moved his arm down for the handball and it is the most certain 100% penalty you'll ever see when you see it tonight.
"So, we've been unlucky on both counts but, if I am honest, I don't think there was anything to referee.
"I thought the attitude of the players was brilliant, up to the penalty decision."
Asked whether he spoke to Oliver afterwards, he said: "Yeah, I always do. I just tell him my opinion.
"I think when you are a young referee you listen and hopefully you learn not just from your assessors but those that have played the game or manage. I made one or two points, which I think will help him when something like that happens again."