Back to the MIT repository
7. AI System Safety, Failures, & Limitations3 - Other

Communication constraints

Communication Constraints. A fundamental source of information asymmetries is that constraints on information exchange can exist, even when agents share a common goal (see Section 2.1). These might be constraints on space (i.e., the amount of information that can be communicated) if the information that needs to be communicated is especially complex, time if a snap decision is required before all information can be communicated, or both.

Source: MIT AI Risk Repositorymit1218

ENTITY

3 - Other

INTENT

3 - Other

TIMING

3 - Other

Risk ID

mit1218

Domain lineage

7. AI System Safety, Failures, & Limitations

375 mapped risks

7.6 > Multi-agent risks

Mitigation strategy

1. Implement robust cryptographic and authentication mechanisms to secure inter-agent communication channels, mitigating the risk of forged messages, signal manipulation, and unauthorized information dissemination that exploits communication constraints. 2. Establish comprehensive, immutable audit trails and real-time behavioral monitoring specifically for inter-agent interactions, enabling the tracing, forensic analysis, and early detection of anomalies or opportunistic actions arising from information asymmetries. 3. Deploy layered system architectures and rigorously evaluate multi-agent communication protocols to optimize information transfer efficiency and manage the space and time constraints inherent in complex, distributed decision-making environments.