A man was forced to leave a Snowy Mountains ski resort after allegedly refusing to cover his face