The push for change on International Holocaust Remembrance Day follows a spate of recent incidents in the state - among them, neo-Nazi leader Thomas Sewell giving the salute outside court in December, the Anti-Defamation Commission said.

More than 20 white supremacists were also seen doing the salute on Elwood Beach days ago, and a group on Australia Day gave the salute during a council event meant to pay respect to Indigenous communities, the commission said.

Victoria Police responded to a protest at a Merri-bek Council event at Coburg and formed a line between attendees and the protesters about 10.15am on January 26, a spokeswoman said.

The event was moved inside and the protesters left, she said. Police would review body-worn camera footage to determine whether any offences occurred.

Attorney-General Jaclyn Symes will meet with commission chair Dvir Abramovich to discuss the potential for legislation.

The "Heil Hitler" salute was a terrifying symbol of Nazism that celebrated Hitler's monstrous legacy and had no place in society, Dr Abramovich and Melbourne Holocaust Museum chief executive Jayne Josem said in a joint statement.

"It is beyond belief that those inflamed with virulent antisemitism, who are using this evil gesture as a rallying cry and who have weaponised the salute to intimidate and terrorise the community, have the law on their side," they said.

It was time to close the lid on the sickening phenomenon of the salute, Dr Abramovich and Ms Josem said.

The state owed it to Holocaust victims, survivors and the diggers who sacrificed themselves to criminalise the "hateful symbol of genocide".

"Let's be clear: performing this salute is a call for murder, and for a Holocaust survivor, seeing it tears a hole in their heart and is as threatening as being held up with a gun," Dr Abramovich and Ms Josem said.

Holocaust survivor Abram Goldberg said the salute should be banned "no question".

"My blood starts to boil when I see the Nazi salute and it brings back the memory of six million Jews who were murdered by the Nazis," he said.

Two other survivors spoke out, with Jack Leder saying allowing people to perform the Nazi salute justified it in the public's eyes while Sarah Saaroni said seeing the gesture brought back memories and pain.

Victorian Environment Minister Ingrid Stitt condemned the salutes on Australia Day as completely unacceptable, and said the government would continue to look at what it could do to legislate against such hateful behaviour.

Victoria was the first Australian jurisdiction to ban the public display of the Nazi swastika.

Australian Associated Press