Environment - Post-Deployment
While highly rare, it is known, that occasionally individual bits may be flipped in different hardware devices due to manufacturing defects or cosmic rays hitting just the right spot (Simonite March 7, 2008). This is similar to mutations observed in living organisms and may result in a modification of an intelligent system.
ENTITY
3 - Other
INTENT
2 - Unintentional
TIMING
2 - Post-deployment
Risk ID
mit613
Domain lineage
7. AI System Safety, Failures, & Limitations
7.0 > AI system safety, failures, & limitations
Mitigation strategy
1. Implementation of Hardware-Based Error Correction Codes (ECC)Utilize ECC memory and logic in critical hardware to autonomously detect and correct single-bit memory errors caused by environmental factors such as cosmic ray secondaries or electrical interference. This ensures data integrity by correcting memory flips in real-time without requiring system intervention.2. Development of Inherently Robust Model ArchitecturesDesign and deploy intelligent systems using techniques that enhance model-level fault tolerance against parameter modification. This includes **parameter quantization** (e.g., binarization) to significantly increase the number of bit flips required to degrade accuracy, and the application of **robust training methods** to simulate and mitigate bit-flip effects.3. Application of Physical Radiation Hardening and RedundancyFor systems deployed in environments with elevated radiation exposure, such as high-altitude or space applications, implement physical **shielding** (e.g., aluminum layers) and **system redundancy** (e.g., Triple Modular Redundancy) to physically block or mask single-event upsets and prevent radiation-induced failures.