The off-colour Swans have plummeted down the table after seven league games without a win.
Williams, 29, said: "We have to be concerned about relegation so we need to get a win.
"But we have to feel confident that what we've got in our dressing-room is enough to take us well away from that. We just need to learn a few lessons quickly and get a bit of experience in the critical moments.
"We've played well in all the games but we're just not getting the result.
"The pleasing thing is that we're all still showing confidence and the manager said that we don't look like a team that haven't won in seven games."
For breaking stories and all the great banter like us on Facebook: facebook.com/tribalfootball