PM defends walking off from distraught mum