Back to the MIT repository
7. AI System Safety, Failures, & Limitations2 - Post-deployment

Financial instability due to model homogeneity

The widespread use of similar models or algorithms across the financial sec- tor can lead to synchronized reactions to market signals, increasing volatility, triggering flash crashes, or market illiquidity [4].

Source: MIT AI Risk Repositorymit1188

ENTITY

3 - Other

INTENT

3 - Other

TIMING

2 - Post-deployment

Risk ID

mit1188

Domain lineage

7. AI System Safety, Failures, & Limitations

375 mapped risks

7.6 > Multi-agent risks

Mitigation strategy

1. Mandate and incentivize systemic model and institutional heterogeneity Establish regulatory frameworks that require and incentivize financial institutions to adopt a diversity of AI and algorithmic models for critical functions like trading, risk assessment, and liquidity management. This structural change directly counteracts model homogeneity, which research indicates increases systemic risk and exacerbates the feedback loop between runs and fire sales during market stress. 2. Establish dynamic, cross-market circuit breakers and enhanced algorithmic oversight Implement coordinated, automated market mechanisms, such as dynamic circuit breakers, that trigger swift intervention (e.g., temporary trading halts) upon detecting synchronized, algorithmically-driven volatility or a sudden, widespread withdrawal of liquidity. This must be coupled with enhanced regulatory surveillance of algorithmic trading strategies to pre-emptively identify and mitigate patterns that could lead to cascading failures or flash crashes. 3. Require the deployment of advanced systemic risk and model monitoring tools Enforce the adoption of sophisticated analytical techniques, such as Graph Neural Networks (GNNs) for systemic risk analysis and advanced model performance monitoring, to continuously evaluate the interconnectedness and potential for correlated failures across the financial system. These tools should provide early warning signals by detecting subtle shifts in market conditions or unexpected, synchronized model outputs that precede financial instability.