Despite playing second fiddle to Brad Guzan in the Premier League, Given has been the first choice for Villa in the FA Cup.
The veteran has played a key role in Villa's fine cup run and former Villa Park star James believes that it is only fair for the ex-Newcastle United custodian to keep his place at Wembley.
He said on BT Sport: "Shay's history and ability tells me that he is good enough to play. I know Brad has been playing well for the last couple of years and believe me, because I've been there, it's frustrating not to be involved in the FA Cup.
"Shay has taken his chance. When he came in against Blackpool the team hadn't been winning. They had a bad run of defeats and draws (in the Premier League) before that so it helped to freshen the team up by playing a different side. In a way the FA Cup team have kept Villa ticking along so I think it would be unfair for Shay not to play."