
This Fragment is the AI Institute Sidebar
This text and the space it occupies will not be visible in the following environments: "View as published", "Preview", "Live"
Key insights from this report
- Multiagent AI systems can help transform traditional, rules-based business and IT processes into adaptive, cognitive processes.
- Organizations should leverage key principles of AI agent and multiagent AI system design and management, which borrow from tenets of composable design, microservices architecture, and human resources deployment and teaming.
- The ability to scale AI agents and multiagent frameworks across a range of use cases depends on developing a comprehensive reference architecture populated with reusable core components.
- A systematic approach can make the difference between incremental, isolated improvements and exponential enterprise transformation.
${pullquote}
Vaulting ahead on the path to GenAI value
Everyone remembers that pivotal moment when we first saw what large language models (LLMs) and Generative AI (GenAI) could accomplish. Suddenly, the long-discussed theory of conversational, intuitive, creative AI became a reality, right there at our fingertips.
But as companies dove into testing GenAI’s potential, many came to recognize the limitations of standalone GenAI models. Context and reasoning limitations of typical LLMs can make it difficult to apply GenAI to complex, multistep workflows. As with traditional AI, hallucination and bias can create significant barriers to trust. And the creative outputs for which GenAI is celebrated require continuous human monitoring for quality and accuracy.
AI agents and multiagent AI systems are helping organizations hurdle these limitations and make the cognitive leap into a new paradigm of business process transformation and innovation.

Business executives say deeply embedding GenAI into business functions and processes is the No. 1 way to drive value from the technology.1
How agents deliver a cognitive advantage
As people, we can understand language and creatively articulate responses. By employing specialized tools, we can amplify our physical and mental capabilities. By learning and remembering information, we avoid mistakes and improve on what we’ve already accomplished.
Language, planning, reasoning, reflection, and the ability to use tools, data and memory: These attributes are central to how AI agents work and demonstrate cognitive abilities as well.
In the realm of business, AI agents and human workers have other similarities. Both must be carefully selected, well trained and well equipped to perform their jobs. And both should be smartly deployed and consistently managed in ways that help ensure efficient, value-adding performance.
Not surprisingly then, our recommended principles of AI agent design and management echo familiar themes from organizational design and human resource management.

${pullquote}
Principles of AI agent design and management
The following approaches can help your organization ensure efficiency and effectiveness across your agentic “workforce.” Read our full report to understand how to put these principles into action.
- Domain-driven approach: Most AI agents should be sourced and/or designed based on specific domain requirements.
- Role-based design: Agents should be designed to perform roles rather than specific tasks.
- Right balance: Find the proper balance between the number and the scope of responsibilities of individual AI agents.
- Controlled access to data, skills & tools: Tools, data & skills made available to a given AI agent should be limited to those that are essential to its role.
- Reflective cycle: Agents should have the ability to critically evaluate their own output.

Adaptive processes for innovative outcomes
As any leader today knows, individual strengths are no match for team synergy. Organized and managed well, teamwork leverages and amplifies the strengths of each individual—making it possible to achieve goals that no person could do alone.
As with people, so too with AI agents. By leveraging an “agency” of role-specific AI agents, multiagent AI systems can understand requests, plan workflows, delegate and coordinate agent responsibilities, streamline actions, collaborate with humans, and ultimately validate and improve outputs.
Multiagent AI systems have the potential to impact every layer of enterprise architecture—not just automating existing processes and tasks, but also reinventing them.
By engaging with users and within workflows semantically rather than syntactically, AI agents can comprehend emerging needs and address them in novel ways that obviate traditional, rules-based processes. By continuously self-monitoring, multiagent AI systems can improve their outputs in near real time. Meantime, the shared persistent state of AI agents in a system enables them to collaborate and coordinate activities in ways that continuously streamline efficiency.

“Synergy (is) the bonus that is achieved when things work together harmoniously.” – Mark Twain
Key principles for effective multiagent AI systems
In our full report we explore how the following principles can help ensure multiagent AI systems are robust, reliable and trustworthy.
- Understandable & explainable systems: Systems should document each agent’s chain of thought.2
- Composable design: Bring best-of-breed components together in a microservices architecture.
- Human in the loop: Knowledgeable humans are essential to safeguard against system errors & biases.
- Dynamic data patterns: Enable data to flow in two distinct patterns: data to the agent and agent to the data.
- Ecosystem integration: Consider system interactions with existing processes & applications.
- Continuous improvement & adaptation: Systems should be designed to evolve.
- Ethical considerations: Ethical principles should guide system design and deployment.

A reference architecture for agent-powered transformation
Scalable impact from multiagent systems depends on treating them as an ecosystem of capabilities instead of solutions and to develop a reference architecture that can support both business and technical delivery processes.<br><br>The essential layers of a reference architecture are shown in the chart below. In our full report, we show how this reference architecture can be put into action through an example use case common to all companies.
Layer | Purpose | Actions for success |
---|---|---|
Interaction | Allow users, processes and existing applications to collaborate with multiagent AI systems. | Develop defensive user interfaces that can anticipate and mitigate potential user errors or misuse, while guiding the multiagent system(s) to respond contextually. |
Workflow | Ensure controlled flow engineering to help agents interact with each other efficiently and in a more deterministic manner. | Implement value-stream analysis to monitor efficiency and effectiveness of workflows. Identify governance guardrails and touch points for human monitoring (“human in the loop”) to help reduce risks. |
Agents | Create, manage, deploy and optimize role-specific AI agents. | Industrialize the creation of role-specific agents. Each agent should be equipped with a fit-for-use language model, tools that augment language model capabilities, approved data, short- and long-term memory, and access to prompts. |
Agent operations | Monitor outputs and metrics to help ensure agents are functioning as expected. | Implement instrumentation and telemetry, along with logs, traces and metrics, to gather data about system activities. Activate alerts and dashboards to simplify performance monitoring. |
Making the cognitive leap
The rapid evolution of multiagent AI systems is transforming how organizations address challenges and streamline processes. By anchoring in the foundational principles we have outlined—and by leveraging a robust reference architecture—your organization can leap ahead and seize the potential of AI agents now.
At Deloitte we’ve gleaned valuable insights that can help your organization drive value from AI agents and multiagent AI systems. Learn more in our full report.

Prompting for action: A series on AI agents and multiagent AI systems
<p>AI agents are opening new possibilities to drive enterprise productivity through business process automation. Use cases that were once thought too complicated for GenAI can now be enabled at scale—securely and efficiently. </p> <p>In this series, we explore what makes AI agents so groundbreaking. And we share tangible recommendations to help C-suite leaders guide the journey for their own organizations. </p>
Contributors to this report: Jim Rowan, Brijraj Limbad, Pradeep Gorai, Caroline Ritter, Brendan McElrone, Laura Shact
Endnotes
- Deborshi Dutt, Beena Ammanath, Costi Perricos and Brenna Sniderman, Now decides next: Insights from the leading edge of generative AI adoption, Deloitte, January 2024, p. 10, https://www2.deloitte.com/content/dam/Deloitte/us/Documents/consulting/us-state-of-gen-ai-report.pdf, accessed September 16, 2024.
- Boshi Wang, Sewon Min, Xiang Deng, Jiaming Shen, You Wu, Luke Zettlemoyer and Huan Sun, Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters, Cornell University, June 1, 2023, https://arxiv.org/pdf/2212.10001, accessed September 16, 2024.