The Hammers were initially awarded the right to move the site following the London Games next summer although a potential deal collapsed once Tottenham and Leyton Orient challenged it legally.
It now appears as though the site will be rented out with West Ham the likely most tenants but Gold now feels unsure about the move even though he wants out of Upton Park.
"I have mixed feelings," Gold told talkSPORT. "The Olympic Stadium is very exciting, but we need a consultancy procedure with our fans, that is important.
"I am ruling out developing the Boleyn, that would be pouring money down the drain.
"But what we can't do is nothing. West Ham have been at the Boleyn for over 100 years. I believe we are the eighth largest supported club in the country, and yet we perform more like the 20th biggest, and that's because we are at the Boleyn.
"So we have to change that. The obvious change that everyone is looking at is the Olympic Stadium. But there is a doubt, there are issues unresolved."