Impact on Financial Stability
The integration of general-purpose AI into high-frequency trading, market-making, or systemic risk management could exacerbate systemic risk by exhibiting unexpected behavioral patterns during market stress. Moreover, the concentration of a few homogeneous foundation models across financial institutions may foster correlated decision-making and herd-following behaviors. The widespread adoption of AI agents could also amplify volatility through emergent phenomena from multi-agent interactions.23 All of these could precipitate a cascading global-scale financial system instability, with potential economic losses exceeding trillion of dollars worldwide.
ENTITY
3 - Other
INTENT
2 - Unintentional
TIMING
2 - Post-deployment
Risk ID
mit1454
Domain lineage
7. AI System Safety, Failures, & Limitations
7.6 > Multi-agent risks
Mitigation strategy
- Mandate rigorous, continuous model validation and monitoring frameworks to detect and limit the risk posed by concentration and uniformity of foundation models across financial institutions, which could lead to correlated, herd-following behaviors - Implement automated crisis facilities and strengthen regulatory capacity for real-time surveillance of AI-driven markets to rapidly manage and interrupt cascading, global-scale financial system instability - Require the integration of Explainable AI (XAI) and Human-in-the-Loop (HITL) systems to ensure human understanding and control over AI agents, mitigating the risk of unexpected or opaque behavioral patterns during market stress