Bolton lost at Burnley, whilst West Ham, Stoke, Wolves and Birmingham all progress. Arsenal took an early lead against North London rivals Tottenham at White Hart Lane only for the hosts to level just after the break.
The score remained at 1-1 until extra time when the Gunners scored three more times, twice from the penalty spot, to progress 4-1.
Henri Lansbury had put Arsenal deservedly ahead in the first half only for Robbie Keane to level early in the second half as Spurs began to fightback.
Extra time began and two Samir Nasri penalties in four minutes followed by an Andrey Arshavin effort meant the bragging rights went to Arsene Wenger's team.
Everton suffered the shock of the round as they crashed out to League One club Brentford on penalties.
The clubs tied at a 1-1 stalemate in regular time but the hosts dominated on spot-kicks 4-3 to deservedly progress.
Seamus Coleman gave the Premiership side an early lead but Brentford equalised through Gary Alexander in the 41st minute.
The Bees then missed a penalty in normal time but made no mistake when it came to sudden death from 12 yards.
Owen Coyle's Bolton suffered a shock defeat on his return to Burnley were he endured a torrid time from the home support on his return.
Wade Elliott scored the only goal of the game on the stroke of half time.
West Ham triumphed at Sunderland in the all Premiership clash.
Frederic Piquionne put the Hammers ahead in the first half but Asamoah Gyan restored parity almost immediately.
New signing Victor Obinna got the eventual winner to bring a little cheer into the Hammers miserable start to the season.
Another all Premiership clash ended in a 2-0 win for Stoke over Fulham at the Britannia Stadium.
Danny Higginbotham in the first half and Kenwyne Jones late on did the damage.
Birmingham were another Midlands outfit to progress, 3-1 at the expense of MK Dons with three goals in four first half minutes by Alexander Hleb, Nikola Zigic and Craig Gardner.
Aaron Wilbraham scored a late consolation for the League One visitor's.
Wolves needed extra time before finally seeing off ten-man Notts County 4-2 at Molineux.
Lee Hughes actually gave County the lead before Nenad Milijas levelled from the penalty spot with seven minutes remaining.
Steven Fletcher and a Kevin Doyle brace in extra time gave Wolves a hard fought win after Kevin Smith had reduced the arrears.
