Prince Edward had a packed itinerary for his 10 hours in Ballarat