Back to the MIT repository
5. Human-Computer Interaction3 - Other

-

Loss of or restrictions to the ability or rights of an individual, group or entity to make decisions and control their identity and/or output due to the use of misuse of a technology system or set of systems

Source: MIT AI Risk Repositorymit1336

ENTITY

3 - Other

INTENT

3 - Other

TIMING

3 - Other

Risk ID

mit1336

Domain lineage

5. Human-Computer Interaction

92 mapped risks

5.2 > Loss of human agency and autonomy

Mitigation strategy

1. Implement Human-in-the-Loop (HITL) processes with defined approval gates and audit schedules, ensuring human operators retain the ability to oversee, validate, and override AI-generated outputs for all critical decisions 2. Employ Explainable AI (XAI) and full system transparency to clarify the reasoning behind AI recommendations, allowing individuals to understand and defend outcomes and preventing the 'black box' erosion of agency 3. Adopt non-coercive and user-centered design principles that allow for customization and prevent the manipulation or undue pressure of users toward specific outcomes, thereby maintaining personal independence