Back to the MIT repository
4. Malicious Actors & Misuse2 - Post-deployment

Sexualization

The non-consensual sexualisation of an individual or group using a technology or application

Source: MIT AI Risk Repositorymit1359

ENTITY

1 - Human

INTENT

1 - Intentional

TIMING

2 - Post-deployment

Risk ID

mit1359

Domain lineage

4. Malicious Actors & Misuse

223 mapped risks

4.3 > Fraud, scams, and targeted manipulation

Mitigation strategy

1. Technical and Platform Design Controls Proactively implement Safety by Design principles by utilizing a gendered-lens risk assessment during the feature engineering phase. Deploy algorithmic detection and content moderation tools to prevent the creation, surfacing, and amplification of non-consensual sexually explicit or manipulated content, such as deepfakes. 2. Governance and Accountability Frameworks Develop and enforce comprehensive platform policies, including a strict zero-tolerance approach to non-consensual sexualization. Establish trusted, transparent, and accessible reporting mechanisms with clear protocols for consistent investigation and enforcement against malicious actors to ensure system-level accountability. 3. User Empowerment and Response Support Enhance user empowerment through mandatory, targeted training and awareness campaigns on the risks of sexualization and targeted manipulation, emphasizing digital boundaries and safe technology use. Simultaneously, provide clear, easily accessible support pathways and trauma-informed resources for affected individuals.