Williams shrugged off the home defeat, but Swansea must bounce back against Tottenham at White Hart Lane at the weekend to keep alive their slim hopes of qualifying for the Europa League.
He said: "We are still 10th, so it's not too bad. We've lost before and bounced back.
"We perform well against the big teams and we did well against Spurs before.
"But the next step for this team is improving the way we play away against the big teams."