The Spanish champions have been reported to be courting the 28-year-old Serbia defender in recent weeks as José Mourinho looks to tighten up Real’s rearguard.
And although Ivanovic admits he is aware of the reported interest from Spain, he insists he is happy to stay at Stamford Bridge.
“I know what has been written about my future and that Madrid are following me, but now is not the time to talk about this,” Ivanovic told Marca.
“I am focused on the national team now and I am very happy at Chelsea.
“I won the Champions League just one week ago and to think about changing clubs now is complicated. I am very happy in London.”
MORE: Man United latest news
MORE: Arsenal latest news
MORE: Chelsea latest news
MORE: Liverpool latest news