Back to the MIT repository
6. Socioeconomic and Environmental3 - Other

Accidents Are Hard to Avoid

accidents can cascade into catastrophes, can be caused by sudden unpredictable developments and it can take years to find severe flaws and risks (not a quote)

Source: MIT AI Risk Repositorymit348

ENTITY

1 - Human

INTENT

2 - Unintentional

TIMING

3 - Other

Risk ID

mit348

Domain lineage

6. Socioeconomic and Environmental

262 mapped risks

6.5 > Governance failure

Mitigation strategy

1. Establish a comprehensive corporate risk governance framework, mandating clear accountability for risk oversight, promoting organizational transparency, and fostering a risk-aware culture across all hierarchical levels to proactively identify and address latent systemic flaws (Governance failure, Sources 11, 14, 16, 20). 2. Implement the Hierarchy of Controls, prioritizing engineering solutions (elimination, substitution) at the source of identified hazards to structurally minimize the likelihood of accidental initiation, thereby preventing an initial incident from cascading into a catastrophe independent of individual-level error (Accidents Are Hard to Avoid, Sources 3, 4, 8, 9, 13). 3. Institute continuous risk monitoring, utilizing regular hazard assessments, performance metrics, and Root Cause Analysis following any near-miss or incident to ensure the sustained effectiveness of control measures and to expedite the detection of severe, unpredictable risks that may otherwise take years to surface (sudden unpredictable developments, Sources 1, 6, 8, 12, 18).