War memorial under threat: former director