White left Qatar to return to the United Kingdom at the end of November without featuring in any of the Three Lions' group-stage fixtures. A Football Association statement confirmed the news and cited "personal reasons" as the reason for the departure while asking for the player's privacy to be respected.
A report from the Daily Star on Thursday claimed White, 25, left England's Al Wakrah headquarters after falling out with Holland. Further, the former Brighton star is understood to have struggled to integrate with the other members of the 26-man squad, leaving him unhappy in the Middle East.
Southgate addressed these claims on Friday, one day before England's quarter-final against defending world champions France. The England manager refused to give the allegations "any form of credibility".
He said on talkSPORT: "What I've been shown was alleged and there was another word that was used.
"I think by commenting on the story I could be giving it any form of credibility, really. We explained why Ben left the camp and I think it's important that that is respected, really."