Module 1 · Lesson 8

Single-Agent vs Multi-Agent Systems

A multi-agent system is not automatically more capable. Start with one agent, then split responsibilities only when specialization, context isolation or ownership boundaries justify the coordination cost.

Updated August 2026 · Multi-agent architecture

What is a single-agent system?

A single agent owns the user-facing task and has access to the tools it needs. It may perform many steps, but one active agent remains responsible for deciding what happens next.

User → General Agent → tools → final answer

This is often the simplest architecture to build, trace and evaluate.

What is a multi-agent system?

A multi-agent system separates capabilities across specialized agents. One agent may route, delegate or coordinate work performed by others.

                  → Research Agent
User → Manager    → Data Agent
                  → Writing Agent

OpenAI's current Agents SDK supports two core orchestration styles: agents as tools, where a manager remains in control, and handoffs, where a specialist becomes the active agent for the rest of the turn.

Manager vs handoff

Manager / agents-as-tools

A manager calls specialists for bounded subtasks, receives their results and owns the final response. This works well when one agent must combine outputs or enforce a unified policy.

Handoffs

A triage agent transfers control to a specialist. OpenAI documents handoffs as useful when different agents specialize in distinct areas such as refunds, FAQs or order status and the specialist should directly own the remainder of the turn.

Why split into multiple agents?

Specialized instructions

A narrow prompt can be easier to optimize than one enormous system prompt covering unrelated tasks.

Tool isolation

A billing agent does not need deployment tools. Reducing each agent's tool surface can make selection clearer and permissions easier to reason about.

Context isolation

Specialists can receive only the context relevant to their job instead of carrying a massive shared conversation.

Different model or cost profiles

Some subtasks may need a stronger model while others can use a cheaper or faster one. Architecture can make those choices explicit.

The coordination tax

Every extra agent introduces handoff or delegation decisions, more prompts, more model calls, more traces and more ways to lose context. Multi-agent systems therefore require a clear reason.

ConcernSingle agentMulti-agent
ImplementationSimplerMore orchestration
ContextShared and straightforwardMust decide what to pass
Tool surfaceCan grow largeCan isolate tools by specialist
TracingEasierMore complex execution graph
LatencyUsually lowerMay add extra model turns
SpecializationOne prompt handles everythingStrong separation of roles

When to stay with one agent

When multi-agent architecture becomes useful

Practical rule: do not split agents because the architecture diagram looks sophisticated. Split when you can name the responsibility boundary and explain what problem the split solves.

Parallel specialists

Some subtasks can run independently. A manager may ask one agent to inspect technical risk while another estimates cost, then combine the results. Parallelization can reduce wall-clock latency when dependencies allow it, but it still increases total work and cost.

Official references