He believes the club's impressive recruitment record means they can land a top notch sporting director when Ashworth leaves.
"He will leave a big space to fill," Olsson told the Birmingham Mail. "But we have lost managers here and recovered.
"There was a big hole left after Roy(Hodgson) departed but the current gaffer has come in and done a brilliant job so far so I have faith the club will find the right man.
"Recruitment in the club, whether it is players, staff, or coaches, has been brilliant."