Scrapping Bolt laws would be a 'green light to racists': Neil Brown