Boss Paul Cook hopes Accrington's good start to the League Two season will help to raise attendances for home matches.
Stanley have won three of their first four League matches, but crowds for their first two games at the Crown Ground have failed to top 2,000.
Cook told BBC Radio Lancashire: "If the attendances drop, it affects the manager in terms of finances.
"But it's something I know the club are trying to work on and it's something I don't think people should clash over."
The former Wolves and Coventry midfielder added: "The crowds we've had for a couple of years have been going that way. We should work together to try and make it better."
Accrington have consistently had one of the lowest average attendances in League Two since winning promotion back to the Football League in 2006.