Back to the MIT repository
7. AI System Safety, Failures, & Limitations2 - Post-deployment

Pattern recognition capability

AI models and systems could exacerbate financial bubbles by reinforcing market trends.

Source: MIT AI Risk Repositorymit1081

ENTITY

2 - AI

INTENT

2 - Unintentional

TIMING

2 - Post-deployment

Risk ID

mit1081

Domain lineage

7. AI System Safety, Failures, & Limitations

375 mapped risks

7.6 > Multi-agent risks

Mitigation strategy

1. Mandate Model Diversity and Systemic Stress Testing Implement regulatory requirements for financial institutions to demonstrate heterogeneity in their deployed AI models to actively combat the risk of "monoculture," where reliance on standardized, "best-of-breed" architectures leads to dangerously correlated behavior across the financial system. Furthermore, require rigorous systemic stress testing that specifically simulates synchronized, AI-driven asset liquidation or position-taking under various market shock scenarios to quantify and mitigate potential procyclicality and contagion effects. 2. Strengthen Macroprudential Speed Controls and Transparency Enhance or develop dynamic market circuit breakers and risk-based halts that can rapidly intervene in high-frequency, automated market cycles to contain emergent, AI-amplified volatility. This must be complemented by mandated transparency requirements, such as requiring clear disclosure or labeling of financial products significantly leveraging AI for core decision-making, to improve supervisory monitoring and address opacity challenges inherent to complex machine learning systems. 3. Enforce Robust Data and Validation Protocols Require financial institutions to establish rigorous data governance protocols to ensure training datasets are free from historical biases that could inadvertently lead to the algorithmic reinforcement of speculative market trends. Model validation must explicitly extend beyond linear historical back-testing, necessitating the use of synthetic data and advanced counterfactual scenario analysis to test the model’s resilience against non-linear, tail-risk events that are poorly represented in recent market history.