Late-night venues were here first says councillor, as Birmingham gay village flats plan raises concerns