Swans are stuck on 39 points after losing four on the bounce.
But Britton said: "This is not a panic situation, but we've lost the last four games in a row and we can't hide from that.
"At the same time, look at the games. Newcastle had two chances and had great finishes. We gave Tottenham a real game, but QPR was different, it wasn't good enough. We conceded on the stroke of half-time and it gave everyone in the stadium a lift.
"We weren't at the races from the first minute to the last and the manager has every right to be disappointed by the performance because it wasn't acceptable."