The man, aged 29, was shot from a car as he walked along Burleigh Road in Pennfields at around 3pm on Tuesday afternoon.
He later took himself to hospital but his injuries are not thought to be life-changing or life-threatening, West Midlands Police said.
The area near the Bruford Arms was cordoned off by officers into the evening as officers started their investigation.
Nobody has been arrested in relation to the shooting.
A spokesman for West Midlands Police said: "The 29-year-old man was walking on the road when a gun was fired towards him from a car, causing injuries to his head.
"He has been taken to hospital and, fortunately, his injuries are not believed to be life-changing or life-threatening at this time.
"Officers have cordoned off the area as enquiries begin."
Anyone with information is asked to contact police by quoting log number 3004 of July 21.
Alternatively, contact Crimestoppers anonymously on 0800 555111 or at crimestoppers-uk.org