The Doll's House pub, in Newbury Lane, Oldbury, has stood derelict for a number of years and calls have been regularly made to demolish it.
The building, which had recently become a potential danger after being targeted by arsonists, was demolished by council contractors over the weekend after its owners failed to comply with a legal notice served on them.
Ward councillor Maria Crompton said in April that the pub needed to be demolished 'as a matter of urgency' and is 'pleased' that the work has been carried out.
She said: "I'm really pleased the building has eventually been knocked down because it had become quite dangerous and was an eyesore.
"I'm sure the nearby residents will be really pleased too because there was some anti-social behavour and and fires happening there.
"The pub has been empty for around three years at least. The council have been trying to chase up the owners for a long time.
"Once down it'll all be fenced off and will be left nice and neat on the corner. It'll be much better for the people that live nearby but it means only a few pubs are left in the area."
A total of 13 firefighters battled a fire at the building for around two hours on April 17. West Midlands Fire Service received 11 emergency calls to the blaze.
In December last year, 30 firefighters tackled another blaze at the pub.
Following the demolition, the site will be levelled and the trees on the land to side of the current building will be removed.
A fence will also be put up around the land to deter fly-tipping, an issue that costs Sandwell Council between £250,000 and £300,000 each year.
When the demolition was initially announced, Jan Britton, Sandwell Council chief executive, said: “The building has become an eyesore and a potential danger to the public.
"Officers have repeatedly asked the owners to remedy the situation however the owners have failed to comply with the legal notice served on them.
"After all of the works are completed the council will pursue the owners to recover the demolition costs.”