Chester opened the scoring in the first half before Ashley Hemmings equalised after 28 minutes. However, Harriers were reduced to 10 men when Amari Morgan-Smith was red-carded after a fracas.
Harriers were made to pay just after the hour when Declan Weeks struck what turned out to be the winner.
In the Southern Premier Central, Stourbridge went down 2-1 at Stratford Town – with the opposition goals scored by former Glassboys Will Grocott and Jordan Williams. Rushall Olympic played out another thriller, this time coming back from 3-0 down at Redditch to force a 3-3 draw thanks to late strikes from Sam Whittall, Nehemia Zazi and a 90th minute leveller from Alex Moore.
Hednesford’s poor start continued with a 3-0 defeat to Coalville Town.
In the Southern League Central Division One, Halesowen smashed North Leigh 5-0, while in the Northern League Division One South East, Chasetown lost 3-1 at home to Kidsgrove Athletic.