The Eagles are reportedly lining up a swoop for their former midfielder, who quit Selhurst Park for Loftus Road last summer.
But Derry told the Ealing Gazette: "I'm looking forward to the derbies. I've never played at Chelsea, I've never played at The Emirates or White Hart Lane.
"And the derby days at Loftus Road – they'll be special. The Rangers fans have made it clear they've been waiting 15 years for this."