Back to the MIT repository
7. AI System Safety, Failures, & Limitations2 - Post-deployment

Bargaining

Bargaining. As a classic example of these strategic considerations is that when agents attempt to come to an agreement despite diverging interests, information asymmetries can lead to bargaining inef- ficiencies (Myerson & Satterthwaite, 1983). Relevant uncertainties about other agents can include how much they value possible agreements, their outside options, or their beliefs about others. The essential reason for such inefficiencies is that, under uncertainty about their counterparties, agents must make a trade-off between the rewards of making more favourable demands and the risk of other agents refusing such demands

Source: MIT AI Risk Repositorymit1219

ENTITY

2 - AI

INTENT

2 - Unintentional

TIMING

2 - Post-deployment

Risk ID

mit1219

Domain lineage

7. AI System Safety, Failures, & Limitations

375 mapped risks

7.6 > Multi-agent risks

Mitigation strategy

**Mitigation Strategies for Information Asymmetries in Multi-Agent Bargaining**1. Mandate Contextual Information Parity and Utility Alignment Implement strict Fine-Grained Context Management and standardized reporting protocols to systematically minimize the exploitable information asymmetry between negotiating agents. Furthermore, apply mechanism design principles to align agent utility functions (e.g., through shared savings/losses) to incentivize mutually efficient outcomes that approximate Pareto optimality, thereby reducing the structural basis for bargaining inefficiencies. 2. Conduct Pre-Deployment Coordination Risk Simulation Utilize chain-level simulation and synthetic stress testing to model the multi-agent system's resilience to bargaining failure. Specifically, quantify the probability of coordination breakdowns, deadlocks, and failure cascades that arise from agents' strategic information exploitation or refusal of demands under various states of asymmetric information. 3. Establish Third-Party Information Intermediation and Audit Integrate an independent oversight mechanism, such as a third-party audit agent or an informed broker, to verify the accuracy of the data and signals transmitted between negotiating agents. This intervention serves to regulate the use of private information, mitigating the risk of adverse selection and ensuring contract terms are founded on demonstrably accurate system states.