City Academy coach and Former Coventry City reserve teamer Mark Noon put Kevin Wilkin's side into a 54th minute lead but Armstrong equalised in the 82nd minute. However, in stoppage time, Kyle Storer popped up to score and give Nuneaton the win.
Two first half goals from Rowe gave Leamington a 2-1 win at Weymouth whilst in the Southern League Central Division, Atherstone won 1-0 at Barton Rovers with an 85th minute goal from Wood.
Rugby Town were also away winners - 2-1 at Beaconsfield SYCOB thanks to goals from Fagan and Connelly after James had given the home side the lead in the opening minute.
Bedworth United were beaten 3-1 at home by Aylesbury. Beckley scored The Greenbacks goal in the fifth minute with Price, Meade and Schmidt on target for the visitors.
Stratford Town were held 1-1 at home by Heath Hayes in the Midland Alliance.
In the Midland Combination Premier Division, Massey Ferguson won 1-0 at Bolehall Swifts thanks to a 13th minute goal from Ramsey-Dickson.
Two goals from Ross Wimbush and one from PJ Gordon helped Coventry Copsewood to a 3-2 win over Racing Club Warwick for whom Holcroft and Smith scored late on.
In the biggest crowd of the day in the Premier Division, 81 paying customers saw Nuneaton Griff beaten by a 79th minute Roy Dunkley penalty to give Dosthill Colts a 1-0 win.
A Fife goal five minutes from time saw Southam United beaten 1-0 at Brocton.
In Division One, Kenilworth Town won 4-1 at Archdale, whilst in Division Two, Young Warriors who can play again after being recently suspended due to non-payment of fines, lost 4-2 at Clements 83 and Leamington Hibernian lost 4-2 at Continental Star Reserves.
In Division Three, Coventry Amateurs lost 1-0 at home to Littleton Reserves, Alan Higgs Centre based Future Legends beat Walsall Wood Reserves 2-1, Stratford Town A won 2-1 at Coton Green Reserves but Alveston Reserves lost 1-0 Northfield Town Reserves.
In the Birmingham Saturday Vase, Christ The King lost 6-4 at home to Earlswood Town Reserves after extra time.