Ramos has hit out at referee Alejandro Hernandez Hernandez following Real Madrid's shock loss.
Los Blancos had appeals for a penalty turned down when they thought Jose Campana had handled the ball in the box and Ramos, who was booked 10 minutes into the match, thinks it's something more personal.
"I don't like talking about referees as they can make mistakes, but sometimes it makes you think," Ramos said.
"The criteria is different.
"They gave a penalty against me for an involuntary handball in the Supercopa de Espana.
"Today, there are two and they don't give it.
"I'm annoyed with Hernandez Hernandez.
"Referees were more respectful before and captains could speak to them.
"The arrogance is something that you have or you don't have.
"I asked [the referee] if he had any personal problem with me and, if he did, to tell me so we could work it out."
"We're annoyed," Ramos said.
"The most decisive moment is arriving and we have to turn the page.
"We were leaders and now we're second.
"Any mistake can leave you without a trophy.
"Then again, there were lots of things surrounding this game...
"But we lost this game, not the referee and not VAR."