The 21-year-old man was shot in Barrett Street shortly before 4.45pm on Wednesday afternoon.
The victim was found with injuries which are not believed to be life threatening and taken to hospital.
Officers from West Midlands Police remained at the scene this evening and have called for anyone with information to contact them.
A spokesman for the force said: "We have launched an investigation after a man aged 21 was shot in Smethwick this afternoon.
"Police were called by paramedics to Barrett Street just before 4.45pm. The victim was found with injuries which are not believed to be life-threatening and taken to hospital.
"The scene remains cordoned off and anyone with information has been asked to contact police."
Barrett Street runs off a busy roundabout junction in Smethwick, connecting Grove Lane, Dudley Road and Cape Hill.
Anyone with information can call West Midlands Police on 101, quoting incident reference number 1884 of September 18. Alternatively, call Crimestoppers anonymously on 0800 555111.