The Reds were lucky not to be held to a draw, having new keeper Simon Mignolet to thank, as he kept out an 89th minute penalty from Jonathan Walters.
Manchester United kicked off life under new manager David Moyes with a 4-1 triumph at Swansea City. Robin van Persie and Danny Welbeck lead the way with two goals each - the Dutchman opening the scoring in the 34th minute with an acrobatic side volley after controlling neatly with his chest.
Welbeck added a second just minutes later when he steered home Antonio Valencia's drive from close range before van Persie made it 3-0 in the 72nd minute with a thunderous strike from outside the area on his trusty left boot.
Swansea signing Wilfried Bony got one back in the 82nd minute with a neat side-footed finish but Welbeck put the nail in the coffin with a deft chip over Michel Vorm in injury time.
Arsenal's season began dreadfully as they were beaten 3-1 at home by Aston Villa despite scoring the opening goal inside seven minutes through Olivier Giroud who swept home Alex Oxlade-Chamberlain's cross from the left.
However, it was all downhill from there as Christian Benteke levelled in the 22nd minute, fortuitously heading home the rebound after Wojciech Szczesny had kept out his penalty which came after the Polish gloveman had felled Gabby Agbonlahor in the area.
Benteke edged Villa ahead just after the hour-mark when he was able to convert from the spot after Agbonlahor had won another penalty although this one was questionable as Laurent Koscielny appeared to take all ball in his challenge. Koscielny was sent off not long after for a second bookable offence before Villa rubbed salt into the Gunners wounds with a late goal from new signing Antonio Luna.
Norwich City managed to score late to force a 2-2 draw with Everton at Carrow Road after going ahead early in the second half through Steven Whittaker. Ross Barkley and Seamus Coleman got the Toffees ahead not long after the hour-mark but summer signing Ricky van Wolfswinkel hit the back of the net for the home side in the 71st minute.
Pajtim Kasami scored the only goal of the game as Fulham travelled to Sunderland to get a 1-0 victory whilst Southampton were gifted a late penalty, converted by Rickie Lambert, to edge West Bromwich Albion 1-0 at The Hawthorns.
On Sunday, Chelsea gave Jose Mourinho a winning return to English football by beating Hull City 2-0 at home thanks to first-half goals from Oscar and Frank Lampard - the second a stunning free-kick - whilst Tottenham got the better of top flight returnees Crystal Palace 1-0 courtesy of a 50th minute penalty from record signing Roberto Soldado.