It's a tough time to be the PM