'It's a bit frustrating': Brumbies fire at critics of Wallabies hopes