In the hierarchy

1. Part III: Governance, Power & Existential Concerns
2. D23. Catastrophic & Existential Risk
3. 23.2 Loss-of-control scenarios

Virtues and principles to explore

Held as inquiry, not as a verdict.

• Hope

  Hope

  Stand in uncertainty, where there is room to act — not in optimism or despair.

• Humility

  Center principle

  The map is larger than any one of us.

• Courage

  Hope

  Act without the comfort of certainty.

Starter questions

Written to probe curiosity and learning, not accusation.

1. 01What capacity would we need — in people, in the institution, in the tools — to meet this well?
2. 02What would Courage require of us here, before we proceed?
3. 03What might we be missing if we treat “Fast takeoff & recursive self-improvement” only as a technical problem?
4. 04If a colleague raised this concern tomorrow, how would we receive it as inquiry rather than accusation?

Also on this branch

• Slow-takeoff gradual disempowerment10
• Multi-agent race to the bottom15

Frameworks and sources

• UK International Scientific Report on Advanced AI Safetyreport
• MIT AI Risk Repositoryframework