Unfortunately, they could not maintain this performance in the second half and let John Jenkinson (2) and Steve Gough score three goals to give Paul Charnley's side a 5-3 win.
Nuneaton Borough are out of the FA Cup after losing 2-1 at Chasetown in the Fourth Round.
Rugby Town drew 0-0 at Mangotsfield but Leamington won 1-0 at Chesham with a Josh Blake goal in the second half with former Sphinx winger Jamie Towers who is on loan from Nuneaton Borough on the bench. Managerless Bedworth came from behind to draw 1-1 at home to Dunstable.
In the Midland Combination Premier Division, Nuneaton Griff lost 1-0 at home to Bolehall but Southam won 5-2 at home to Pilkington.
Leamington Hibernian beat Thimblemill Rec 2-1, but Kenilworth Town lost 3-1 at RC Warwick Reserves.
In the Telegraph Cup, Coventry Copsewood won 5-0 at Alveston, Massey Ferguson won 3-1 at Brooklands Jaguar and Stockingford beat Bedworth Ex Service 5-3.