Groups urge PM to invest in social housing