In the hierarchy

1. Part III: Governance, Power & Existential Concerns
2. D23. Catastrophic & Existential Risk
3. 23.2 Loss-of-control scenarios

Virtues and principles to explore

Held as inquiry, not as a verdict.

• Hope

  Hope

  Stand in uncertainty, where there is room to act — not in optimism or despair.

• Humility

  Center principle

  The map is larger than any one of us.

• Courage

  Hope

  Act without the comfort of certainty.

Starter questions

Written to probe curiosity and learning, not accusation.

1. 01Whose experience of Multi-agent race to the bottom is not yet in the room — and how would we hear it?
2. 02What is already being done about this, and by whom — and how would we find out without assuming?
3. 03What conversation have we not yet had about this — and who needs to be in it?
4. 04Who is served by addressing this, and who benefits if we leave it unnamed?

Also on this branch

• Fast takeoff & recursive self-improvement5
• Slow-takeoff gradual disempowerment10

Frameworks and sources

• UK International Scientific Report on Advanced AI Safetyreport
• MIT AI Risk Repositoryframework