Torres rejoined Los Rojiblancos in 2015 after having his struggles in spells with AC Milan and Chelsea, but even after returning to the Estadio Vicente Calderon, things never quite clicked as before for Torres.
"I don't know if it was a personal thing, something professional or a bit of both," Torres said in a documentary on his career.
"I understand the complication of managing an arrival like mine.
"I was never the starting striker in his head.
"You can accept not being a starter for 40 games, but you can't accept being among those not called up."
Despite their differences, Torres had no doubts that Simeone valued him as a player.
"I know him well and I knew that he expected a lot from me," he added.
"I knew he'd test me and that he wouldn't give me anything, but also that he loved me as a footballer."