The Serbia international is a top target for Real coach Jose Mourinho.
"I know what has been written about my future and that Madrid are following me, but now is not the time to talk about this," Ivanovic told Marca.
"I am focused on the national team now and I am very happy at Chelsea.
"I won the Champions League just one week ago and to think about changing clubs now is complicated. I am very happy in London."