Back to the periodic table
88ra-88
Us

Undersp.

Severity5/10

Underspecification

Ambiguity in the learning problem specification resulted in multiple models with similar test performance but radically different behavior in production.

Periodic recordReliabilityarXiv2021

Andreas Triantafyllopoulos, Manuel Milling, Konstantinos Drossos, Björn W. Schuller

Mitigation Strategy

Rigorous formal specifications of model requirements, comprehensive evaluation on diverse distributions, and detailed documentation of design decisions.

Atomic Number

88

Us

Risk ID

ra-88

Severity

5/10

Severity Level

88
Reliability
ra-88
Us

Undersp.

Underspecification

RiesgosIA.org
Reliability • #88

Underspecification

Us
Severity Level5/10

Definition

Ambiguity in the learning problem specification resulted in multiple models with similar test performance but radically different behavior in production.

Mitigation Strategy

Rigorous formal specifications of model requirements, comprehensive evaluation on diverse distributions, and detailed documentation of design decisions.

Notes / Observations

1.
2.
3.
4.
5.
RiesgosIA.org • Periodic Table of AI RisksRiesgosIA.org