Collins believes some Villa fans have caned Big Eck simply because he is the ex-boss of Birmingham City.
He said: "There are certainly a number of fans who are still not too happy with the manager. So one bad performance and that was going to happen, which is wrong really.
"I think the manager has come in and done a great job and some of the fans have to realise that he's here to help Aston Villa.
"We are working tremendously hard for him."