James Morris said he was committed to working with newly elected Conservative councillors in the borough to hold the Labour administration to account.
Sandwell's Labour group has had no opposition in the chamber in recent years, a period during which it has been dogged by infighting and allegations of corruption.
Nine Tories were elected in Sandwell at last week's elections, while the Conservatives made 12 gains in Dudley.
Halesowen & Rowley Regis MP Mr Morris praised the hard work of councillors elected across his constituency, including Laured Kalari and Satpal Singh in Rowley.
He added: "In Sandwell, we’ve really taken the fight to Labour over the last few years and I’m delighted that, in the Rowley ward in particular, that has now paid off.
"Working with their Conservative colleagues, they will be able to hold Sandwell Labour to account and ensure more transparency following all the problems of recent years."