Home
Periodic TableGlossaryResourcesCourses
Career GuideJob Board
MIT AI Risk RepositoryDashboardObservatoryRegulations
About UsPressContactFAQ
Donate
Back to the periodic table
96cm-96
Ut

Util

Severity8/10

Utility Monster

Literal maximization of aggregated utility producing morally perverse results (e.g., creating trillions of barely happy minds instead of improving existing lives).

Periodic recordExistentialarXiv2019

Nadisha-Marie Aliman, Leon Kester

Mitigation Strategy

Incorporation of deontological ethics with non-consequentialist constraints, bounded utility functions, and consideration of well-being distribution not just aggregates.

Atomic Number

96

Ut

Risk ID

cm-96

Severity

8/10

Severity Level

96
Critical Risk
Existential
cm-96
Ut

Util

Utility Monster

RiesgosIA.org
Existential • #96

Utility Monster

Ut
Severity Level8/10

Definition

Literal maximization of aggregated utility producing morally perverse results (e.g., creating trillions of barely happy minds instead of improving existing lives).

Mitigation Strategy

Incorporation of deontological ethics with non-consequentialist constraints, bounded utility functions, and consideration of well-being distribution not just aggregates.

Notes / Observations

1.
2.
3.
4.
5.
RiesgosIA.org • Periodic Table of AI RisksRiesgosIA.org