The group turned up outside the player's house to demand that he sign a new deal eight years ago after reports of Chelsea interest had been reported.
Ferdinand was asked to come to the door but could not see anyone on his security monitors.
The 34-year-old told Four Four Two magazine: "So I go to the side door and grab a big bit of wood, jump on the side of the wall and I'm just about to scream 'raaaah!' when I see there's a massive group of people, with hoodies and caps covering their faces.
"I just thought, 'I'm going to get served up in a moment, so go bananas and they'll think you're a nutter!'
"Then one of them said, 'We're the United boys, f***ing sign your contract,' and I was like, 'What you talking about? I've only just started negotiating two months ago, what you worrying about?"'
Explaining the background, he added: "Basically I went to see my agent for half-an-hour and (Peter) Kenyon was with him.
"Someone's taken a picture and made out like we're having a bloody meal together. So I'm saying to these guys, 'If I'm going to do a deal with another club, do you think I'd be doing it in broad daylight?'
"One of the neighbours had called the police by then and they got off when they heard the sirens."