Ferdinand believes that Pogba should make a decision over whether he remains at Old Trafford for the immediate future.
"Does he want to stay or go?" Ferdinand said on BT Sport. "Does Ole want to keep him? Once that's ironed out you can build your team."
The 41-year-old also admitted that Ole Gunnar Solskjaer's attempts to haul the club back to the pinnacle of English football will require more time.
He added: "They understood as a group that it wasn't going to happen overnight. I think this team are turning the corner but it's a slow process.
"It's not something we can look at and go right, 'that's a big change and Man United are back winning trophies'.
"This is a slow burn, though, after a few years of topsy-turvy times."
Need a VPN? Or seeking to switch? Then support Tribal Football by clicking here to sign up with our official partners NordVPN. Not only will you receive the best VPN experience, but also great discounts by signing up via Tribal Football. Thanks for your support!