Back to the periodic table
92u-92
Se

Improv.

Severity10/10

Recursive Self-Improvement

Intelligence explosion via accelerated self-improvement cycles where an AI iteratively redesigns its own architecture, potentially reaching superintelligence rapidly.

Periodic recordExistentialarXiv2024

Xunjian Yin, Xinyi Wang, Liangming Pan, Li Lin, Xiaojun Wan, William Yang Wang

Mitigation Strategy

Physical limitations on computational resources, absolute sandboxing during development phases, self-modification capability monitoring, and pauses at capability thresholds.

Atomic Number

92

Se

Risk ID

u-92

Severity

10/10

Severity Level

92
Critical Risk
Existential
u-92
Se

Improv.

Recursive Self-Improvement

RiesgosIA.org
Existential • #92

Recursive Self-Improvement

Se
Severity Level10/10

Definition

Intelligence explosion via accelerated self-improvement cycles where an AI iteratively redesigns its own architecture, potentially reaching superintelligence rapidly.

Mitigation Strategy

Physical limitations on computational resources, absolute sandboxing during development phases, self-modification capability monitoring, and pauses at capability thresholds.

Notes / Observations

1.
2.
3.
4.
5.
RiesgosIA.org • Periodic Table of AI RisksRiesgosIA.org