United States international Guzan felt the victory was testament to the spirit within the Villa squad, forged during last season's battle for survival.
"We are confident in what we are about as a team, in our abilities," he said.
"We wanted to come down here and make a statement."
Villa head to Chelsea for a rearranged match on Wednesday night.
Guzan added: "To come down here and get a result like we did, we can take this result forwards.
"We know there is a lot of football to be played in a long season ahead of us, so we will enjoy this now, then be focused and ready to go again at Chelsea."
For the big stories and the banter follow us on Twitter: @tribalfootball