It comes as traditional owners from Far North Queensland and the Torres Strait are due to give evidence as an inquiry into the proposed body resumes.
Mr Albanese said the prospect of cases being brought before the courts due to the wording had been shot down by Australia's top constitutional law experts.
"This is a legally sound proposition. It makes it very clear that parliament is in charge," he told 2SM Sydney on Wednesday.
"There's no obligation and there's certainly not an obligation on the government to agree to the voice. There is the provision for the voice to be heard, for at least the views to be put."
The third hearing of the parliamentary inquiry into the voice to parliament and executive government will be held in Cairns on Wednesday.
The committee is examining the proposed constitutional changes and the question that will be taken to the public before the terms of the referendum are locked in by federal parliament.
Torres Strait Island councils and traditional owner groups from Cape York and the Torres Strait are among those giving evidence at Wednesday's hearing.
Committee member and Labor senator Nita Green said it was critical to hear local communities' thoughts on the voice.
"No member of the committee is leaving any stone unturned when it comes to seeking the right evidence and the right support and the right advice," she told Sky News.
"We're doing that and we're doing it diligently because we know how important this committee is not only to the Australian people and to the parliament but to all of the people who care about the voice."
Australians will vote in the referendum on the voice between October and December this year.
The inquiry examining the voice started last week and has held hearings in Canberra and Orange in the NSW central west.
"What we're asking people and talking to people about in those committees about what they think about the legislation ... what they think about the wording, and does the wording give effect to what they want to see a voice to parliament do and what it can achieve," Senator Green said.
Mr Albanese said the solicitor-general's view on the voice would be released soon and accused Opposition Leader Peter Dutton of running scare campaigns on the body.
"Peter Dutton can continue to wallow in his negativity," Mr Albanese said on Tuesday.
"I think that Australians will judge him for that."
The Liberal Party has called for a legislated but not constitutionally enshrined voice process involving representative local and regional bodies.
"We've been clear. We don't want an elitist model, which is what the prime minister is proposing," Mr Dutton said on Tuesday.
"It's a Canberra voice. It's not going to represent the views of those local communities."