Accidental harm
Automation in sectors ranging from manufacturing to healthcare has and will increasingly put humans into close contact with EAI systems [7]. This interaction increases the risk of accidental physical harm. Though accidental harm has been a longstanding issue in industrial robotics, increased AI capabilities could exacerbate this risk; several recent reports document an increase in industrial injuries following the introduction of AI-controlled robots [66–68].
ENTITY
3 - Other
INTENT
2 - Unintentional
TIMING
2 - Post-deployment
Risk ID
mit1425
Domain lineage
7. AI System Safety, Failures, & Limitations
7.3 > Lack of capability or robustness
Mitigation strategy
1. Prioritize Engineering Safety Measures and Standards Compliance: Implement or integrate physical safeguarding devices (e.g., interlocks, light curtains, fixed barriers) and ensure AI systems, particularly collaborative robots, are equipped with certified safety-rated sensors (e.g., Safety PLCs, PLd-certified LIDAR) to achieve compliance with international standards (e.g., ISO 10218, ANSI/A3 R15.06-2025). This includes integrating features like Speed and Separation Monitoring (SSM) and Power and Force Limiting (PFL) to minimize the risk and consequence of accidental physical contact. 2. Institute Proactive AI-Powered Risk Detection and Intervention: Deploy real-time, video AI or predictive observability systems to continuously monitor the work environment for procedural violations, such as unauthorized entry into hazardous zones, improper Lockout/Tagout (LOTO) practices, and missing Personal Protective Equipment (PPE). This facilitates a shift from reactive incident reporting to preemptive intervention and targeted coaching. 3. Enforce Comprehensive Procedural, Training, and System Lifecycle Controls: Require rigorous, application-specific risk assessments before deployment and throughout the system lifecycle. Establish and enforce clear administrative controls, including mandatory LOTO procedures and accessible emergency shutdown protocols. Ensure all personnel interacting with or working near the AI systems receive recurrent, equipment-specific training on safety protocols and hazard recognition.