Zouma was shown two yellow cards for dissent as he argued about the award of a corner which eventually led to Watford's winning goal.
"I will try and speak with the referee now, if he stays here, because I spoke with Kurt at the end of the match," Silva said.
"He told me, he received yellow card and then the referee gave the second yellow card to him.
"It is the moment for our players to be calm but sometimes that is not easy and the referee has to understand because many, many mistakes are coming against our team.
"It is not easy sometimes to understand everything and they cannot understand the referee and his assistant.
"It is not a case for Kurt to do something at the end of the match because the game is finished.
"What he said to the referee is what all our players are saying in that moment.
"It wasn't a corner and they asked for them to see that because it was clear.
"At the award of the corner, all of our players go to speak with the referee, and after the goal they go to speak with the referee because it wasn't a corner."