West Brom raced into a three-nil second half lead at Arsenal but a late rally had the Baggies hanging on for a famous 3-2 victory.
Albion could have taken a first half lead but Manuel Almunia saved Chris Brunt’s penalty.
Peter Odemwingie then scored and moments later Gonzalo Jara doubled the visitor’s lead.
Jerome Thomas took advantage of poor keeping by Almunia to make it three with 17 minutes remaining. Then the Gunners launched a fightback.
Sami Nasri reduced the deficit and in the final minute added a second but it was too little too late.
West Ham moved off the foot of the table with a 1-0 win at Upton Park over London rivals Tottenham.
At Anfield Liverpool’s disappointing season continued with a 2-2 draw against Sunderland.
The Reds took an early lead through Dirk Kuyt but Darren Bent restored parity before the break from the penalty spot.
The Black Cats then took the lead just after the break when Bent headed his second.
But Steven Gerrard spared Roy Hodgson’s blushes by grabbing a point in the 64th minute.
Seasiders skipper Charlie Adam headed an own goal on 20 minutes trying to find his keeper Matthew Gilks.
The hosts looked to have salvaged a point when substitute Matt Phillips levelled with five minutes remaining, but Rovers sub Brett Emerton scored the winner in injury time.
There were no goals at St Andrews either as Birmingham and Wigan ended in a scoreless stalemate.
The Blues Craig Gardner's red card late on for a challenge on Franco Di Santo was the main talking point of a disappointing game.