Modric was a star for Spurs in the Premier League before moving to Real to win trophies.
He has been very successful since then, and could have gotten a move even earlier if he had gotten his way.
A move to Chelsea in 2011 did not materialize, despite the player even refusing to travel to Spurs' pre-season tour that year.
"Despite all the turbulence in the summer of 2011 and what followed later, I always had a good relationship with Daniel Levy," the 34-year-old said in his autobiography 'Luka Modric: My Autobiography'.
"First and foremost, he was the one who brought me to Tottenham - for a record fee in the club's history. That only showed how highly both he and the club thought of me.
"They gave me a big chance. My status at White Hart Lane was excellent, and I think I earned it with my behaviour, performances and by always giving my best for Spurs.
"Generally speaking, Daniel Levy is an excellent chairman who fights for Spurs' interests. The club's recent results only attest to this.
"However, I resented him because on a couple of occasions he had promised to let me move to a bigger club and then broke his promise. For me, one's promise and one's word are more important than anything.
"Anyone who knows anything about my relationship with the clubs I have played for knows money has never been my priority otherwise, I would have chosen some other destinations and be better off financially."