Back to the MIT repository
5. Human-Computer Interaction3 - Other

Autonomy

Autonomy - Loss of or restrictions to the ability or rights of an individual, group or entity to make decisions and control their identity and/or output.

Source: MIT AI Risk Repositorymit941

ENTITY

3 - Other

INTENT

3 - Other

TIMING

3 - Other

Risk ID

mit941

Domain lineage

5. Human-Computer Interaction

92 mapped risks

5.2 > Loss of human agency and autonomy

Mitigation strategy

1. Mandate and implement a comprehensive Human-in-Command (HIC) or Human-on-the-Loop (HOTL) governance framework for all AI systems that affect individual or organizational autonomy. This requires establishing clear human accountability for system outputs, defined approval gates for critical decisions, and routine audit schedules to ensure human agency supersedes algorithmic action in all consequential contexts. 2. Enforce the use of Explainable AI (XAI) and transparency standards to prevent opaque decision-making. System design must provide clear, accessible rationale for all restrictive or identity-impacting outputs, thereby enabling users to effectively query, contest, and seek redress for AI-driven decisions. 3. Develop and institute mandatory 'Agency Preservation' training and literacy programs across all stakeholder groups. These initiatives must actively promote critical evaluation of AI recommendations, raise awareness of cognitive offloading and automation bias, and foster the conscious cultivation of independent judgment to mitigate the risk of dependency and the subtle erosion of human autonomy.