“baby/juvenile-AGI that is about to turn mature any month/week/day/hour now.
This calls for an AGI Manhattan Project!”
Probably too late for a Manhattan Project to be the appropriate response at that point. Negotiation or military action seem more feasible.
Robin, I mentioned hyperbolic discounting above. Why do we have evolved pure time preference rather than just discounting for risk, return on investment, etc? If tweaking motives requires fewer independent changes than a massive improvement in our ability to reason about and predict the future, then evolution will do the former.