Angel Gomes' 80th minute winner was overshadowed by a freak injury to Bailly, which saw the Ivorian stretched off the pitch shortly after he was introduced at half-time.
"It's never nice getting an injury and not worth it," Solskjaer told reporters.
"He's done his knee, but we're not sure how bad.
"We need to get him back to Manchester and do scans. We'll hope for the best."
He added in an interview with MUTV: "It doesn't look great, but let's see how it goes."