City suffered a very disappointing 2-1 defeat against Watford at the Liberty Stadium on Saturday and Clement has challenged his side to return back to winning ways when they square off against the Hammers at the Olympic Stadium next weekend.
Clement said: "It's the most frustration I have shown outwardly, and I was frustrated after the Newcastle performance.
"I know this team can do a lot better and at the moment they are not playing to their potential and we have to quickly find a way to find that.
"Losing at home means we now go away next week to a team who have also not had a very good start and we have got a good result there.
"We got a result against a Tottenham team who were expected to beat us and next weekend we need another result, not a point but all three points."