Residents say new five-storey building will ruin Curtin's character