Improper usage
Improper usage occurs when a model is used for a purpose that it was not originally designed for.
ENTITY
1 - Human
INTENT
2 - Unintentional
TIMING
2 - Post-deployment
Risk ID
mit1299
Domain lineage
5. Human-Computer Interaction
5.1 > Overreliance and unsafe use
Mitigation strategy
1. Establish a comprehensive AI governance framework that clearly defines the model's acceptable use cases, explicitly prohibits unintended applications, and mandates human review and approval for all AI-assisted decisions. 2. Implement rigorous and continuous educational programs to train end-users on the model's specific capabilities, inherent limitations, and the necessity of maintaining professional judgment to prevent overreliance. 3. Integrate technical and procedural controls, such as monitoring for unusual query patterns and requiring users to document the inputs, outputs, and their final verification of AI-generated content to ensure traceability and auditability.