AI Engineering Paper #5: Why Multi-Agent Systems Fail
In this live class, we will be going through the "Why Do Multi-Agent LLM Systems Fail?" research paper by Mert Cemri, Melissa Z. Pan and others, with Matei Zaharia and Ion Stoica.
The paper studies 1,642 traces from seven multi-agent frameworks and names 14 ways these systems fail. We will also look at Anthropic's multi-agent research system, which beat a single Claude Opus 4 agent by 90.2% on its research eval, and used about 15 times the tokens of a chat.
----------------------------------------
Registrations for AI System Design Cohort 2026 have started.
The cohort will start on 7th November 2026.
Main topics:
Week 1. Agentic System Design
Week 2. Search and Retrieval
Week 3. Evals and Agent Security
Week 4. Agent Deployment and CI/CD
Week 5. Observability and Scaling
Week 6. Production Capstone
Dates: 7th Nov to 13th Dec 2026
Time: Sat & Sun, 9 to 10:30 AM IST
This cohort is for software engineers who want to build AI systems for production.
You can register here: https://aiengg.dev/?utm_source=youtube&utm_medium=live&utm_campaign=paper-5
Cheers!
Paper link: https://arxiv.org/abs/2503.13657
Anthropic's report: https://www.anthropic.com/engineering/multi-agent-research-system
Github resources: https://github.com/InterviewReady/ai-engineering-resources
AI Engineering Cohort: https://aiengg.dev/