There's a growing need for a federal population minister