Olsson disappointed West Brom haven’t picked up more points
The Baggies have made a solid start to the new campaign with seven points from five matches.
Olsson, who found the back of the net in their 3-1 win over Birmingham, insists their form has lifted everyone's confidence.
"We feel like we could have had a few more points," Olsson told the Birmingham Mail.
"Seven after five games is pretty good and we'll go to the Emirates and try and get something out of that game.
"It will be difficult but we feel, like we did at Anfield, that on a good day we can get something out of any game.
"We'll go there with confidence but first we have the Carling Cup. They are live or die and that's exciting.
"The key for us to staying up is making The Hawthorns a fortress. So far, so good - let's keep it up.
"Saturday's win against Birmingham was a good result. It gives us a boost - and in a derby is nice as well.
"The nicest wins are when you come from behind. It strengthens the confidence and morale."