Gradual Disempowerment
Jan Kulveit, Raymond Douglas, Nora Ammann, Deger Turan, David Krueger, David Duvenaud — 2025-01-28 — Various academic institutions — arXiv
Summary
Develops the concept of ‘gradual disempowerment’ as an existential risk scenario where incremental AI capability improvements progressively erode human influence over critical societal systems (economy, culture, governance) through both weakened control mechanisms and misaligned optimization pressures.
Source
- Link: https://arxiv.org/abs/2501.16946
- Listed in the Shallow Review of Technical AI Safety 2025 under 1 agenda(s):
- aligned-to-who — Multi-agent first