Gonzalo Higuain struck twice with Jack Bonaventura also scoring for the 3-1 win.
"The performances were always there, we were just missing the three points. The worst performance was on Thursday against Olympiacos," Gattuso told Sky Sport Italia.
“We made mistakes again today, gifting their goal, but we always want to play the ball. This wasn't a team in crisis before, it just struggled to kill games off after good performances.
“At times we run a few too many risks at the back, but we do want to play the ball and keep it moving.
“Higuain is a champion, a great finisher, a lad who at this moment is working really hard for the group, is demanding and also well-loved.
“The team creates a great deal and frankly we could do with more quality from Hakan Calhanoglu, who can create many more chances for Higuain, but isn't very sharp right now.
“We have to improve on the left, as we were far stronger there last season. Franck Kessie played below par in the first half and wasn't very dynamic today, but I like to give more width to the team."
Gattuso was asked about his man-management style inside the Milan locker room.
“I just want players who understand me when I speak, who are paying attention. Not everyone has the same character, some need a pat on the back, others for you to raise your voice at them, so you treat them all differently."