The two women got into trouble in Port Phillip Bay near the Frankston Yacht Club late on Tuesday night.

The Water Police, Air Wing and other emergency services scoured the area for the pair.

They were found about half an hour later by a volunteer rescuer and returned to shore.

It was the second paddle board rescue in the area that day, after four teenagers went missing nearby.

Two 18-year-old men and two women, 18 and 19, set off from Rosebud beach late on Monday and spent hours adrift in the bay after they got caught in strong winds.

The group eventually washed up unharmed at a military base on Swan Island off the Bellarine Peninsula on Tuesday morning.

Survivor Rong Shi told ABC TV the group stared to lose hope of being rescued when they saw police helicopters and boats searching for them but the group couldn't attract their attention.

"Stay alive, that's all we had to do," Mr Shi said.

"It still feels like a dream to me, I can't believe it. I can't believe we made it.

"I mean like if you look back it's really, it's a miracle."

It is very easy for paddle boarders to be swept out to sea because their body can act as a sail in strong winds, according to Liam Krige, general manager of operations at Surf Life Saving Victoria.

"It is really concerning to see a number of paddle boarders getting into trouble, particularly in the last 24 hours," Mr Krige told 3AW radio.

Stand Up Paddle Victoria secretary Mark Thomson said anyone who was thinking of trying out the sport for the first time this summer needed to pay particular attention to the wind.

"People think they're paddling out on a reasonably calm day and before they know it they get out 30 or 40 metres and bang, they just get picked up by the wind and taken," Mr Thomson told AAP.

"As those young people said, you know, they couldn't paddle against that wind.

"They had no chance, they just had to go with it."

Australian Associated Press