Back to the MIT repository
5. Human-Computer Interaction2 - Post-deployment

Improper usage

Improper usage occurs when a model is used for a purpose that it was not originally designed for.

Source: MIT AI Risk Repositorymit1299

ENTITY

1 - Human

INTENT

2 - Unintentional

TIMING

2 - Post-deployment

Risk ID

mit1299

Domain lineage

5. Human-Computer Interaction

92 mapped risks

5.1 > Overreliance and unsafe use

Mitigation strategy

1. Establish a comprehensive AI governance framework that clearly defines the model's acceptable use cases, explicitly prohibits unintended applications, and mandates human review and approval for all AI-assisted decisions. 2. Implement rigorous and continuous educational programs to train end-users on the model's specific capabilities, inherent limitations, and the necessity of maintaining professional judgment to prevent overreliance. 3. Integrate technical and procedural controls, such as monitoring for unusual query patterns and requiring users to document the inputs, outputs, and their final verification of AI-generated content to ensure traceability and auditability.