Public servants told it's Armidale or find new jobs