France international Diaby has risked incurring the wrath of his own Gunners fans with the statement.
Diaby said in The Sun: "It's more difficult to wear in the street. There you are not safe."
The 25-year-old went on to intimate that he would consider making a switch to White Hart Lane in the future.
He said: "It would be good to play for the same club one day."