The French centre-back has generally struggled in his first season-and-a-half at the Etihad Stadium since arriving on big money from FC Porto in the summer of 2014.
However, summer arrival Nicolas Otamendi did not escape the wrath of Carragher who feels that perhaps City needs to reinvigorate it's ageing backline in the next two transfer windows.
"I think they may have this problem again in the summer with these because of the age of those players and the youngest one they have got is Mangala, who is not good enough," he said on Sky Sports' Monday Night Football.
"He has been here 18 months and had his time and I think City know that as well; they tried to move him on to Valencia.
"And Otamendi has come in as well, another one in his twenties, who is still yet to show us what we think he may be capable of. But he is struggling as well.
"So it looks like in the summer they could be needing one or two players, but you think of the money they have spent, £70m on two centre-backs, and they can't play without (Vincent) Kompany."