After beating North Leigh 5-0 in midweek, Halesowen continued their free scoring by taking control in the first half, Simeon Cobourne scoring twice, once from the spot, Jamie Molyneux having given them an early lead.
Such was the level of performance in the first half, Molyneux was only just denied a second and a Yeltz fourth by goalkeeper Craig Hill just before the break.
The warning signs were there for Halesowen in the second half though when they gave away a penalty which saw Steve Diggin hit the post and a three goal blast in under ten minutes stunned them. Jordan Crawford produced a far post finish on the hour mark and then two minutes later a stunning strike to put Corby back in the game.
Charlie Wise headed in on 69 minutes and Connor Furey got the winner with a close range follow up on 83 minutes after Halesowen goalkeeper Bradley Catlow had denied Diggin.
Halesowen now face two tough-cup fixtures in a week when they travel to Cambridge City in the FA Cup tomorrow night (Tuesday) and Corby again in the FA Trophy next Saturday.
Team: Catlow; Wright; Manning; Carter; McCone; Parsons; Hawker; Holmes; Cobourne; Molyneux; Hewitt