Goalkeeper Vigouroux and centre-half Williams were unable to handle the hot Barnsley attack, who recorded their first win in four games.
Swindon manager Mark Cooper admitted after the game his side "defended terribly".
Vigouroux and Williams are on-loan with the Robins until the end of the season.
Need a VPN? Or seeking to switch? Then support Tribal Football by clicking here to sign up with our official partners NordVPN. Not only will you receive the best VPN experience, but also great discounts by signing up via Tribal Football. Thanks for your support!