United travel to Reading next week for the fifth round.
A win over the Royals will put them into the last eight of the FA Cup - a competition they have not won since 1925.
Wilder said: “We are after more. We have got some fantastic games coming up and a tough FA Cup cup tie that we will go and attack.
“We are in a groove, we are in a good place, the club is in a good place. I have to make sure this continues."