Fergie is facing a charge over his blast at a linesman after the 1-1 draw at Spurs last Sunday.
He said: "I just think it is more about me than what I've said. Whether I think it is unfair or not doesn't matter to them really at this point.
Ferguson was this week asked by the FA for his comments regarding his criticism of assistant Simon Beck.
He had questioned Beck's performance rather than suggest there was any bias against United.
And Fergie insisted: "That is what I have put in my letter exactly. But you know the FA.
"You never know. It is one of these things. We are high profile."
When it was put to Ferguson he may not be charged he replied: "I wouldn't bet on it."