Firefighters are unlikely to bring the bushfire that has ravaged the area around Lancefield under control until Friday, as they struggle to battle the blaze on difficult terrain.

Hundreds of people still do not yet know whether their houses have survived the blaze that swept north of the small town, as CFA and police roadblocks remain in place.

Emergency services have confirmed two houses have been destroyed, with locals suggesting at least two more have been burnt down, along with a number of civic buildings and sheds.

The CFA had hoped to bring the 4000-hectare fire under control by Thursday night but was racing to gain the upper hand before a northerly wind change and possible thunderstorms on Saturday.

"We were hopeful that we would have that contained by tonight but it now appears that it will be within the next 24 hours," CFA spokesman James Todd said on Thursday afternoon.

"The fire is burning slowly, it's really just the rocky and steep terrain that's stopping us getting in there and finishing the job off."

Mr Todd said forecast temperatures in the mid-20s and light winds on Friday offered a window of opportunity to contain the blaze before the weekend.

Some residents have been allowed to return to their homes within the fire-affected area and safety teams are assessing the area so more can do the same.

Fire crews had made significant gains at the fire in Tallarook on Thursday, with the fire now burning within containment lines, Mr Todd said.

At the historic Mechanics Institute in Lancefield locals, perhaps 200, gathered to receive updates on the fire situation and vent their fury at government and emergency services representatives.

Wayne Rigg, the CFA's air attack supervisor, arrived at the 11am meeting after flying by helicopter around the perimeter of the blaze, which continues to burn.

"In contrast to the last few days, I've been over the fire this morning, it's a lot quieter," he said.

"There it a lot of unburnt fuel within the fire. But the edges have now been trapped with ground crews, so there's no running fire that I could see this morning. That does not mean that it won't change, but I've got five helicopters dropping plenty of water on it this afternoon."

"From what I can see  out there, there are a number of assets that I have seen lost. I can't tell you where they are or which ones they are. There are trees down everywhere over every road. We'll be overhead all day."

One Lancefield man believed he had suffered almost one hundred thousand dollars in property damage from the fire.

The real venom of the meeting was reserved for a representative from the Department of Environment, Land, Water and Planning, the agency that conducted the burn off.

Ken Wright called on police to focus less on roadblocks and more on arresting the "moron" at the Department who controlled the backburn.

"Heads should roll", he said.

Fire officials who started the bungled burn are stressed and in need of support, says the state's government's chief fire officer.

But, while fire chief Alan Goodwin said the Cobaw forest burn-off's escape was regrettable, he denied emphatically the operation had been under-staffed and ignorant of pending heatwave conditions.

There have been reports from the Lancefield area that there were not enough firefighters on the ground last week, with some levelling the blame at the inaugural grand final eve public holiday.

The planned burn was first lit last Wednesday.

"Going into a public holiday and a long weekend has no impact on the way we resource our burns in anywhere in the state," Mr Goodwin said.

The number of resources allocated was based on estimated risk and weather conditions, the Department of Environment, Land, Water & Parks fire chief said.

"It is certainly regrettable, our staff are stressed about this, it is important to support them," he said.

Mr Goodwin said the Lancefield fire team would have been aware of the weekend's weather forecast and planned to have the prescribed fire controlled by the time the hot weather arrived.

Meanwhile, Premier Daniel Andrews arrived in the bushfire stricken town of Lancefield on Thursday with a message for furious locals: "You have a right to be, and we're pretty angry too"

The Premier took leave from parliament to arrive, in blue jeans and brown boots, in an unannounced visit to the small northern town.

He met CFA volunteers and locals affected by the blaze, before being drawn into a conversation with a young local woman who, close to tears, told him of her fears of bushfire in a town where mobile phone reception is patchy at best.

"You should have been here yesterday, people were pretty angry," she said.

"You've got every right to be, and we're pretty angry too," he replied.

"I cannot explain to why what happened happened. But that's why we're having the review. Strength to you. It cannot be easy."

The external review, led by the director of Western Australia's Office of Bushfire Risk Management Murray Carter, will examine whether enough staff were allocated throughout the burn.

The review panel will also include Lancefield community local Vivien Philpotts, and Parks Victoria regional operations director Jo Richards.

Emergency Services Minister Jane Garrett said relief payments of $1300 had already been made to 17 people.

Ms Garrett said 4000 hectares had been burnt already but authorities were hopeful that better conditions would see the fire controlled by Thursday night.

She said two houses and six sheds had been lost, with some department vehicles damaged by falling trees.

Compensation will be considered by the review panel, and Environment Minister Lisa Neville said water used from private dams would be replaced.