The abuse related to the controversial events that took place at the Emirates last season, when Brown's assistant Brian Horton accused Gunners' skipper Cesc Fabregas of spitting at his feet after the FA Cup quarter-final. The Catalan was later cleared of any wrongdoing.
"I don't like that at all. I don't agree with it at all," the Frenchman told the club's official website.
"Once again, I'm a guy who can have something happen which is very bad and the next day I've forgotten about it.
"I'm not someone who remembers things for six months."