Back to the MIT repository
1. Discrimination & Toxicity2 - Post-deployment

Allocative Harms

These harms occur when a system withholds information, opportunities, or resources [22] from historically marginalized groups in domains that affect material well-being [146], such as housing [47], employment [201], social services [15, 201], finance [117], education [119], and healthcare [158].

Source: MIT AI Risk Repositorymit140

ENTITY

2 - AI

INTENT

2 - Unintentional

TIMING

2 - Post-deployment

Risk ID

mit140

Domain lineage

1. Discrimination & Toxicity

156 mapped risks

1.1 > Unfair discrimination and misrepresentation

Mitigation strategy

1. Prioritize Upstream Data and Model Auditing Mandate comprehensive auditing of all training and validation datasets to identify and remediate sources of historical and representation bias that perpetuate systemic inequities in resource allocation. During model conception, explicitly define and incorporate fairness-aware objectives, such as an equity index or fairness constraints, to ensure the resulting algorithm is designed to achieve an equitable distribution of opportunities rather than merely replicating past patterns (Source \[1\], \[3\], \[6\]). 2. Integrate Human Oversight and Transparency Protocols For all high-stakes allocation decisions (e.g., employment, finance, healthcare), implement a Human-in-the-Loop framework where expert reviewers retain the authority to audit and override automated decisions to catch and correct immediate allocative harms prior to final action (Source \[7\], \[18\]). Ensure full transparency and explicability of the allocation logic, facilitating due process and allowing affected individuals to understand and appeal adverse decisions (Source \[15\], \[17\]). 3. Establish Continuous Post-Deployment Monitoring Develop and execute a continuous monitoring and auditing framework to systematically track the model's performance on fairness metrics and track for bias drift post-deployment. This process must regularly test for systematic disparities in resource or opportunity allocation across all relevant demographic and socio-economic groups, mandating immediate corrective action or model recalibration upon the detection of an emerging allocative harm (Source \[7\], \[18\]).