The Hallmarc development was headed for a VCAT hearing in May until Mr Wynne's decision to "call it in" earlier this month.
Save 51 Trees member Donna Winter-Irving said Mr Wynne's sudden decision to call the project in and fast-track the decision-making process had prevented her group - now 250 members strong - from appealing the removal of vegetation at the Elloura site.
The group has campaigned to save 51 grassy box woodland trees, listed to be removed to make way for the lifestyle village, for the past year.
“This is a community that's been denied the democratic right to appeal a decision,” she said.
“The thought of the trees being cut down, and not to be heard in a democratic way . . . is pretty shattering.
“It's their land, but they don't own the earth.”
A decision on the project was fast-tracked to a standing advisory committee set up due to the COVID-19 pandemic, that has been accelerating "priority projects" to bolster Victoria's economic recovery.
“They say it's because of COVID-19 they're fast-tracking, but it's not a facility for affordable housing, it's a lifestyle village,” Mrs Winter-Irving said.
The 49-hectare village will feature a range of sites, a tennis court, swimming pool, gym, function room and play area.
“We're not against the development, we want a rework and a better design,” Mrs Winter-Irving said.
“We lost the VCAT hearing and the right to be heard . . . we need to be heard in front of a panel.”
Mrs Winter-Irving said a last ditch attempt at a roundtable would likely be the group's final chance to save the trees - some of which were over 300 years old.
“We need big activism here,” she said.
Longwood Plains Catchment Network chairperson Rhonda Robinson said she was "very surprised" Mr Wynne had called the project in due to the small scale of the development.
“Most of the projects that get called in are huge developments they want to get going to get people in jobs and keep the economy going,” she said.
“We've never been against the entire project, we would just like it to go ahead in a different format that will save those 200, 300-year-old trees.
“People come to Nagambie for the tree change. The city is crying out for more trees and here we are, we have them, and we're pulling them out where we don't really need to.
“They say the development is held up by us, but the only one holding it up is the developer.”
Euroa Environment Group's Shirley Saywell said the COVID-19 pandemic "should not be an excuse to fast-track poor planning decisions".
“Why should the Elloura development at Nagambie . . . be exempt from proper scrutiny,” she said.
“The Elloura development will destroy significant stands of mature eucalypts and impact habitat and, in doing so, effectively deny tree-changers the real change they are seeking.
“This is wrong-headed.”
A final decision will be made by Mr Wynne after the advisory committee presents its report in early March.
Hallmarc and Mr Wynne's office were approached for comment.