Sunderland have made a £4m bid for the Wales international centre-back which has reportedly been rejected by the Swans, although they are likely to return with an improved offer.
Williams' representative Jamie Moralee said: "We'll see what happens. A bid's come in from Sunderland, but I've got no control over who bids for my players and neither has the player.
"At the moment, Ash is in Sardinia, I'm in Brazil and [Swansea chairman] Huw Jenkins is somewhere else.
"It's up to Swansea to make him an offer because he doesn't want to leave. Just because a club has put a bid in, that's not to say Ash wants to leave - that's far from the truth.
"There's been a lot of interest in Ash and that was always going to be the case, particularly as he only has one year left on his contract. How we've arrived at this situation, I don't know. If we'd talked about the contract in January we wouldn't be in this position.
"When players go into their last year it's dangerous. This is business, it's not personal. Hopefully we can get the situation put right for all parties."
For the big stories and the banter follow us on Twitter: @tribalfootball