Back to the MIT repository
1. Discrimination & Toxicity2 - Post-deployment

Alienation

Alienation is the specific self-estrangement experienced at the time of technology use, typically surfaced through interaction with systems that under-perform for marginalized individuals

Source: MIT AI Risk Repositorymit144

ENTITY

3 - Other

INTENT

2 - Unintentional

TIMING

2 - Post-deployment

Risk ID

mit144

Domain lineage

1. Discrimination & Toxicity

156 mapped risks

1.3 > Unequal performance across groups

Mitigation strategy

1. **Implement Proactive Equitable Design and Data Auditing** Systematically integrate "Inclusion by Design" principles throughout the entire AI lifecycle, prioritizing the collection of diverse and representative training data to ensure uniform quality-of-service performance across all affected subgroups. This necessitates a mandatory, early-stage assessment of potential Quality-of-Service Harms to prevent unequal performance that disproportionately impacts marginalized individuals. 2. **Employ Granular Bias Mitigation and Subgroup Optimization** Move beyond aggregate fairness metrics to actively optimize model performance and predictive accuracy *within* vulnerable subgroups, as failure to do so can lead to continued or exacerbated disparities. This involves rigorous definition and continuous re-evaluation of intersecting demographic and usage subgroups to ensure that mitigation efforts are targeted and do not negatively affect other populations. 3. **Establish Mechanisms for Agency, Transparency, and Feedback** Design system interfaces that preserve human agency by providing transparent explanations for AI decisions and offering opportunities for user control and override of automated outcomes. Post-deployment, maintain safe, continuous feedback channels from diverse community members to monitor for emerging feelings of self-estrangement and adapt the system based on lived experiences of alienation.

ADDITIONAL EVIDENCE

It [voice technology] needs to change because it doesn't feel inclusive when I have to change how I speak and who I am, just to talk to technology