There are reports that the 63-year-old will part company with Villa because of concerns over his health after his recent heart problems.
Downing, who is being linked with a move to Liverpool, said: "Obviously we're reading the reports that Gerard Houllier has gone - but we've not heard anything.
"We got told at the end of the season that he was fit and well and he would be coming back to Villa.
"I had no problems with him. He came in at a tough time. He did quite well with the team. I've enjoyed working with him."