Ballarat's vulnerable deserve better than a two-line response as the government plans demolition