Shorten defends port worker free speech