Feds urge unity as Vic premier faces heat