The likes of Scott Sinclair and Joe Allen have been linked with moves away since the end of last season.
Williams told the South Wales Echo: “One of the main thing this summer was about keeping the top players to keep us moving forward.
“If we’re to do anything this year we have to have our best players.
“Speculation will happen and you can’t do anything about it. You switch off from it as players and let people talk.
“We know the score, we’re all used to it, even Joey in his short career. I’m sure he’s not fussed.”