The West Midlands club have started life in the Championship under Roberto Di Matteo with just one win and five draws from their opening eight matches in what has been a mediocre beginning.
Summer signing Jedinak, who previously captained Crystal Palace, suggests the form of the team is not too bad at the moment but has called on the playing group and the fans alike to really create a buzz around Villa Park for the once famous outfit.
"It's such a big football club, it needs to be in the right place. If we could do something well this year, on and off the field, I think the sky's the limit with this football club," the Australian skipper said on the EFL Weekly Podcast.
"We've got guys here whose football ability is not in question, and that's something that needs to be finely-tuned, and that comes with worth ethic and setting standards.
"We've done it in 45 minute blocks, or something like that. It's about doing it all the time.
"Sometimes you might not be able to win pretty, but at this level, because the games come thick and fast, it's about points.
"To build Villa Park into a proper fortress, that's something I know my team-mates and I are looking forward to."
Villa next take on title favourites Newcastle United, who were likewise relegated from the Premier League last season, at Villa Park on Saturday.