Back to the MIT repository
4. Malicious Actors & Misuse2 - Post-deployment

Information Manipulation

The distortion of the information ecosystem, including the spread of misinformation, fake news, and other forms of deceptive content [28], is categorized as “Information Manipulation.”

Source: MIT AI Risk Repositorymit715

ENTITY

3 - Other

INTENT

1 - Intentional

TIMING

2 - Post-deployment

Risk ID

mit715

Domain lineage

4. Malicious Actors & Misuse

223 mapped risks

4.1 > Disinformation, surveillance, and influence at scale

Mitigation strategy

1. Implement comprehensive, automated, and manual Information Integrity Monitoring and Verification systems to continuously track the information ecosystem for the rapid detection of distorted content, applying robust provenance checks and third-party auditing protocols to ensure data authenticity prior to dissemination. 2. Establish a structured, cross-platform Rapid Refutation and Containment framework, utilizing evidence-based communication techniques—specifically prebunking to proactively counter false narratives and debunking that prominently features accurate, corrective information from authoritative sources to minimize the continued influence effect. 3. Invest in systemic, whole-of-society Digital and Media Literacy Initiatives to cultivate critical thinking, increase public awareness of common manipulation tactics (e.g., emotionally charged language, deep fakes), and foster a societal culture of source verification and judicious sharing behavior to enhance resilience against deceptive content.