Mr Doyle was made a Companion of the Order of Australia in 2017 for service to the people of Melbourne through local government and his contribution to youth, social welfare and medical research foundations.
In a notice posted to the Australia Gazette on Friday, Governor-General David Hurley terminated Mr Doyle's appointment late last month.
Separate investigations by the City of Melbourne and Department of Health found Mr Doyle behaved inappropriately towards three women, including two councillors and a woman at a Melbourne Health awards ceremony in 2016.
He did not take part in any of the inquiries citing his mental health, but vigorously denied the allegations and resigned as lord mayor in February 2018.
Under the Council of the Order of Australia's constitution, the governor-general can terminate an appointment or cancel an award if they deem the holder has behaved in a way that brought "disrepute" on the order.
About 50 awards have been terminated or cancelled since 1975, while others have been given back voluntarily.Â
Other grounds for termination or cancellation include if a holder is convicted of a crime or offence, or an "adverse" finding is made against them by a court, tribunal or other body exercising judicial or administrative power.
The former Victorian opposition leader and Liberal MP apologised for his actions in 2021 in a radio interview but declined to address the specific findings made against him.
The governor-general's office has been contacted for comment.
