Arsenal defender Dan Ballard scored for Northern Ireland in their 4-1 thrashing of Lithuania on Thursday.
In just fifth appearance for Northern Ireland, Ballard tapped home an excellent low cross from Conor Washington to open the scoring in Vilnius.
Charlton star Washington then netted a penalty to make it 2-0.
Rolandas Baravykas pulled one back for the hosts, but they were unable to tie the score when Bailey Peacock-Farrell saved a Arvydas Novikovas spot-kick.
Shayne Lavery restored Northern Ireland's two-goal lead before Paddy McNair completed the scoring with another penalty.
Ian Baraclough's men are now third in Group C after claiming their first win of the World Cup 2022 qualifying campaign.