Chorley were finding life back in National League North a bit tough after their relegation from the National League and were still looking to register their first points of the campaign at the fourth attempt.
The visitors welcomed back Cliff Moyo and Luke Maxwell after injury but striker Amari Morgan-Smith started the first of his two game suspension for his dismissal against Chester.
The home side started brightly, Mike Claverley denied by the alert Luke Simpson and an Alex Penny goal line clearance keeping out Ollie Shenton’s fierce drive.
Lewis Reilly fired wide on 11 minutes as Harriers struggled to get a hold on the game.
The visitors hung together and Ashley Hemmings effort forced a fine block from home keeper Matt Urwin, which seemed to lift Harriers who got their passing game together.
Omari Sterling saw his goal bound effort clip the heels of Leather on the goal line before opening the scoring less than sixty seconds later.
Hemmings corner was only partially cleared, with the follow up delivery reaching Sterling 12 yards from goal. The young striker clipped a sumptuous chip over the stranded keeper to give Harriers a 40th minute lead.
Harriers stretched their advantage a minute into time added on, Sterling providing the finishing touch after his initial effort had been blocked on the line by Lewis Baines to put the visitors in command at the break.
Chorley came out of the blocks all guns blazing, Elliot Newby volleying narrowly wide before Harry Cardwell sent a header against the base of an upright on 56 minutes.
Alex Penny once more rescued his team with his second goal line clearance to again deny Ollie Shenton and Calveley was denied by keeper Simpson as the visitors kept them at bay.
Harriers could have sealed it and eased their nerves on 75 minutes but Sterling lifted his effort over the bar from distance with only Urwin to beat.
Harriers strengthened their resolve to see out the game and take the three points with a first ever league win at Victory Park.
Chorley: Urwin, Birch, Leather, Baines (Conn 72), Halls, Walker, Newby, Calveley, Shenton, Cardwell (Marah 85),Reilly (Rodwell-Grant 60)Subs Not Used: Smith, Baxter.
Harriers: Simpson, Penny, Richards, Lowe, Taylor, Austin, Montrose, Prosser, Hemmings (Moyo 63),Sterling (Maxwell 85),Freemantle(Arthur 78).Subs Not Used: Palmer, White.