A comparative and constructive framework for multi-agent system architectures in autonomous AI reasoning

by Djimit

I. Introduction

A. Shift from Monolithic LLMs to Agentic Systems as the New Frontier in AI Architecture

The landscape of Artificial Intelligence (AI) is undergoing a significant transformation, characterized by a decisive shift away from monolithic Large Language Models (LLMs) towards more distributed, collaborative, and dynamic multi-agent systems (MAS). This evolution marks a new frontier in AI architecture, driven by the pursuit of systems capable of more complex reasoning, interaction, and autonomous operation in multifaceted environments.¹ The proliferation of LLM-based multi-agent systems (LLM-MAS) is a clear indicator of this trend, with LLM agents now capable of invoking other autonomous agents, thereby forming intricate networks of specialized capabilities.³ This transition is not merely an architectural preference but represents a necessary evolutionary step to address and overcome the inherent limitations of singular LLMs when confronted with complex, multi-step, and dynamic real-world tasks.

Monolithic LLMs, despite their impressive capabilities in natural language understanding and generation, are often characterized as static models, primarily confined to single-turn, text-to-text interactions.⁴ Real-world problems, however, frequently demand continuous interaction with an environment, the sophisticated use of diverse tools, robust planning capabilities, and persistent memory – functionalities that are more naturally and effectively realized within agentic structures.⁴ Multi-agent systems, by distributing cognitive labor across specialized agents and enabling modular functionality, can address problems of significantly greater complexity and scale than those manageable by single-agent or monolithic approaches.⁶ This inherent capacity for distributed problem-solving directly confronts the constraints faced by a solitary LLM attempting to manage the entirety of a complex task. Consequently, the movement towards agentic systems is propelled by the fundamental need for AI solutions that are more robust, adaptable, and scalable, capable of mirroring the nuanced and multifaceted nature of human problem-solving and collaboration. The emergence of frameworks like LangChain, AutoGen, and CrewAI further underscores this shift, providing developers with the tools to construct these sophisticated agentic ecosystems.⁸ Recent research highlights the evolution from standalone LLMs to AI Agents capable of tool integration and sequential reasoning, and further to Agentic AI, characterized by complex multi-agent collaboration and orchestrated autonomy.³⁸

B. Meso Focus: Mapping MAS not just as Toolchains but as Cognitive and Epistemic Infrastructures

To fully harness the potential of multi-agent systems, it is imperative to move beyond a purely functional conceptualization of MAS as mere toolchains or execution pipelines. This research advocates for a more profound understanding, viewing MAS as cognitive and epistemic infrastructures – systems that not only perform tasks but also embody cognitive processes, manage knowledge, and engage in collective reasoning. This perspective aligns with the central aim of this thesis: to reframe MAS architectural patterns as “cognitive schemas” rather than simple execution graphs. The significance of this reframing is underscored by the theoretical goal to provide an “epistemological reframing of MAS patterns…as cognitive schemas.” Such a view finds support in research on cognitive MAS designed for emergent properties like data distribution, where agents actively reason about information ³⁹, and in frameworks like A&A (Agents and Artifacts), which model working environments with artifacts specifically for cognitive multi-agent systems.⁴⁰

Conceptualizing MAS as cognitive and epistemic infrastructures necessitates a shift in evaluation metrics and design principles. If MAS are merely toolchains, evaluation tends to focus on input-output performance, latency, throughput, and other traditional software metrics. However, if they are understood as cognitive infrastructures, then the process of reasoning, the quality of knowledge generated and managed within the system, and the adaptability of their collective cognitive strategies become paramount. This shift directly addresses the research aim to benchmark “coherence” within MAS. This deeper perspective helps to explain the focus on issues such as “inefficiencies in coordination, emergent brittleness, and hidden complexity,” which are indicative of failures within a complex cognitive system rather than simple malfunctions in a toolchain. The proposed MAS Pattern–Function Ontology (M-PFO) is intended to capture this more profound cognitive and epistemic role of architectural patterns, linking them to functions that transcend mere execution.

C. Micro Gap: Lack of Systematic Comparison and Constructive Pattern-Use in Current MAS Deployments

Despite the rapid proliferation and increasing sophistication of MAS, a significant micro-gap persists in the foundational understanding and systematic application of their architectural design. The core research problem addressed herein is the conspicuous absence of a consolidated, comprehensive framework for systematically evaluating MAS architectural patterns. This deficiency has led to design decisions that are often heuristic, resulting in systems that can be brittle, difficult to scale, and poorly transferable between different domains or problem types. The “Research Problem” statement clearly delineates this gap, emphasizing that current MAS deployments frequently suffer from inefficiencies in coordination, exhibit emergent brittleness, and harbor hidden complexities. This observation is corroborated by literature highlighting a “lack of a standard template for documenting design patterns for MAS” and noting that “associations between patterns are poorly described,” which consequently hampers their effective utilization by practitioners.⁴¹ Furthermore, contemporary approaches to LLM-MAS often depend on “ad-hoc solutions” and “heuristic mechanisms” that lack robust theoretical underpinnings or guarantees.¹

This identified micro-gap can be understood as a direct consequence of the rapid, LLM-driven expansion of MAS capabilities, a phenomenon where technological advancement has outpaced foundational research into systematic design and rigorous evaluation methodologies. The “proliferation of multi-agent systems (MAS) in AI—driven by advances in large language models (LLMs)” signifies a period of swift growth. In such phases of rapid technological development, the emphasis often falls on demonstrating novel capabilities rather than on cultivating a systematic understanding of the underlying principles. The resultant lack of a “consolidated framework” and the prevalent reliance on “heuristic” design choices are symptomatic of a field where practical application has, in some respects, sprinted ahead of comprehensive theoretical formalization.¹ This situation creates a critical imperative for the research proposed in this thesis: to retroactively construct this systematic understanding and to furnish a constructive framework that can guide more principled and effective MAS design.

D. Aim: Articulate, Test, and Formalize the Logic of MAS Design

This thesis aims to develop a systematic architectural framework for multi-agent AI systems. This will be achieved by:

• Critically evaluating coordination patterns prevalent in MAS.
• Mapping these architectural patterns to real-world application topologies and their functional compositions.
• Benchmarking the performance, coherence, and other critical characteristics of these pattern-topology combinations across diverse use cases, including search, memory utilization, and tool integration.
• Proposing a novel typology for optimal MAS design, explicitly aligned with task complexity and the cognitive requirements of the system. The overarching goal is to articulate, empirically test, and ultimately formalize the underlying logic of MAS design, moving towards a more principled and constructive approach.

E. Overview: The Study Unfolds from Pattern Analysis to Application Taxonomy, and from Simulation Benchmarking to Design Framework Synthesis

The research journey presented in this thesis will commence with a thorough analysis of existing and emerging MAS architectural patterns. This will be followed by the development of an application taxonomy based on canonical MAS use cases. Subsequently, a rigorous simulation and benchmarking phase will assess the efficacy of different patterns across these use cases. The insights derived from these empirical evaluations will culminate in the synthesis of a novel design framework, including the proposed MAS Pattern–Function Ontology (M-PFO). This structured progression aims to provide a comprehensive and actionable understanding of MAS architectures.

II. Theoretical and Contextual Background

A. Review of MAS Literature: From Symbolic Agents to LLM-Powered Multi-Agent Ecosystems

The field of Multi-Agent Systems (MAS) has a rich history, evolving from early symbolic AI paradigms to the sophisticated LLM-powered ecosystems prevalent today. This evolution reflects broader shifts in AI, particularly in how intelligence, reasoning, knowledge representation, and learning are conceptualized and implemented. Understanding this trajectory is crucial for contextualizing the current challenges and opportunities in MAS architecture. This review will focus on key developments, drawing from influential publications primarily within the JAAMAS, AAMAS, AAAI, and IJCAI venues.

Symbolic agent architectures, such as Soar and ACT-R, laid much of the groundwork for contemporary MAS. Soar, developed by Laird, Newell, and Rosenbloom, is a general cognitive architecture designed to integrate knowledge-intensive reasoning, reactive execution, hierarchical problem-solving, planning, and learning from experience, with the ambitious goal of achieving human-level cognitive abilities.⁴² Its core processing cycle is characterized by parallel rule firings, the proposal, selection, and application of operators to modify a working memory state, and a mechanism of impasse-driven subgoaling to resolve situations where knowledge is insufficient.⁴³ Soar has been applied to complex simulations, including TacAir-Soar and RWA-Soar, which modeled pilots in large-scale distributed military training exercises, demanding sophisticated communication, coordination, and cooperation among multiple agents, both human and artificial.⁴³

Similarly, ACT-R (Adaptive Control of Thought-Rational), developed by John R. Anderson, is a cognitive architecture that provides a theory of how human cognition operates, implemented as a framework for creating computational models.⁴⁴ ACT-R comprises distinct modules, such as perceptual-motor systems and memory systems (declarative and procedural), which interact via buffers. A pattern matcher selects production rules that fire to alter the state of these buffers, simulating cognitive processes. ACT-R is a hybrid architecture, combining symbolic rule-based processing with subsymbolic mechanisms (often mathematical equations) that govern aspects like memory retrieval probabilities and learning rates.⁴⁴ It has been successfully used to model a wide array of cognitive tasks, including learning, memory recall, problem-solving, and has found application in developing cognitive agents for training environments.⁴⁴

The advent of Large Language Models (LLMs) has catalyzed a paradigm shift, leading to the emergence of LLM-powered Multi-Agent Ecosystems. These systems leverage the advanced natural language understanding, generation, and reasoning capabilities of LLMs to enable more fluid and sophisticated interactions between agents.¹ LLMs often serve as the “cognitive core” of individual agents, allowing them to interpret complex instructions, access and process vast amounts of information (often through Retrieval Augmented Generation – RAG), engage in intricate reasoning, and communicate using natural language.¹ Frameworks such as LangGraph, CrewAI, and AutoGen are at the forefront of this new wave, providing tools and abstractions for building and orchestrating these LLM-based agents into collaborative systems.⁸ However, this new paradigm is not without its challenges. LLM-MAS often exhibit inherent unpredictability, can suffer from the propagation of uncertainties or hallucinations, and face issues like knowledge drift where the collective understanding of the system degrades over time.¹ The leading conferences in AI and MAS, such as AAMAS, AAAI, and IJCAI, are increasingly featuring research that explores both the potential and the pitfalls of these LLM-driven agentic systems.⁴⁸

The following table (Table 2.A.1) provides a structured comparison of these two broad approaches to MAS:

Table 2.A.1: Comparative Analysis of Symbolic Cognitive Architectures and LLM-Powered Multi-Agent Systems

The transition from symbolic MAS to LLM-MAS signifies a fundamental change in the approach to building intelligent systems. Symbolic architectures like Soar and ACT-R necessitate meticulous, explicit encoding of knowledge and cognitive processes; their behavior is largely governed by these carefully engineered rules and structures.⁴² In contrast, LLM-MAS derive a significant portion of their behavior from the vast datasets on which the underlying LLMs are trained, as well as from their dynamic interaction protocols.¹ While these systems can be guided through prompting and fine-tuning, their internal reasoning pathways often remain opaque, contributing to their characteristic unpredictability.¹ This evolution implies that ensuring reliable, predictable, and aligned behavior in LLM-MAS demands a different set of techniques. The focus shifts from perfecting rule specification to developing robust prompting strategies, effective fine-tuning methodologies, human-in-the-loop oversight mechanisms, and methods for managing complex emergent phenomena. A central challenge that arises is that of “epistemic validation” – the ability to ascertain why an LLM-based agent arrived at a particular decision or how it “knows” what it asserts. This challenge directly connects to the thesis’s aim to reframe MAS as epistemic infrastructures, where the generation, management, and validation of knowledge are as critical as task execution.

B. Critical Survey of Emerging Architectural Primitives

The design and implementation of modern Multi-Agent Systems, particularly those powered by LLMs, rely on a set of emerging architectural primitives. These primitives include fundamental patterns of agent interaction and coordination, as well as common functional compositions that enable complex behaviors.

1. Patterns: Parallel, Sequential, Loop, Router, Aggregator, Network, Hierarchical

Architectural patterns define the fundamental ways in which agents within an MAS are structured and interact to process information and achieve goals. Each pattern offers distinct advantages and disadvantages regarding aspects like processing speed, complexity management, and communication overhead.

• Parallel Pattern: In this pattern, multiple agents operate concurrently on different components or subsets of a complex task.⁶⁵ Each agent typically works independently, and their individual outputs may be consolidated at a later stage. The reasoning paradigm is rooted in the “divide-and-conquer” strategy, allowing specialized agents to apply their unique expertise or models to distinct facets of a problem. While parallel architectures excel in maximizing throughput and computational efficiency, they necessitate careful orchestration to manage data dependencies, avoid race conditions, and ensure transactional integrity, especially in sensitive applications like financial payment processing or portfolio risk assessment.⁶⁵
• Sequential Pattern: This pattern arranges agents in a linear pipeline, where the output of one agent serves as the input for the subsequent agent.⁶⁵ This creates a structured series of transformations or processing steps, with each agent responsible for a specific stage in the workflow. The underlying reasoning paradigm is akin to “chain-of-thought” processing, breaking down complex tasks into manageable, ordered steps with clear dependencies and information flow. Examples include mortgage approval processes or insurance claims handling.⁶⁵ A primary performance consideration is the potential for bottlenecks, as the overall system speed is constrained by its slowest component. However, this pattern is well-suited for tasks with mandatory sequential checks or where decision quality relies on properly ordered evaluations.⁶⁵
• Loop Pattern: The loop pattern establishes iterative processing cycles where agents continuously refine outputs based on feedback or further processing.⁶⁵ This creates a dynamic system capable of progressive improvement through repeated evaluations and adjustments. The reasoning paradigm embodies “reflective reasoning” and “self-improvement,” allowing agents to iteratively enhance solutions until they meet predefined quality thresholds or convergence criteria. A critical performance consideration is the implementation of well-defined termination conditions to prevent infinite processing cycles. Loop patterns are particularly valuable for optimization problems or tasks requiring high accuracy through successive refinement, such as memory transformation for improved recall.⁶⁵
• Router Pattern: This pattern incorporates a central agent or mechanism that dynamically determines which specialized agent(s) to invoke based on the characteristics of the input, current state, or specific logic.⁶⁵ This creates an adaptive workflow where processing paths can change based on requirements. The reasoning paradigm implements “conditional reasoning” or “decision trees,” enabling the system to select the most appropriate processing pathway for each input or situation. Router patterns excel at managing complexity through specialization but demand comprehensive and robust routing logic. The router itself can become a single point of failure, necessitating redundancy or failover mechanisms in critical systems.⁶⁵ This pattern is effective in tool-rich environments or for dynamic task assignment, such as routing queries to agents with access to specific databases or tools [User Query Addendum].
• Aggregator Pattern: In the aggregator pattern, outputs from multiple agents are collected and synthesized by a dedicated aggregator agent (or mechanism) to produce a cohesive final output.⁶⁵ This pattern enables the combination of diverse perspectives, analytical results, or partial solutions. The reasoning paradigm implements “consensus mechanisms” and “information synthesis.” Performance considerations include the need for robust conflict resolution mechanisms if agent outputs diverge. Techniques like weighted voting or confidence-based aggregation are often employed, particularly when the cost of error is high.⁶⁵ This is useful for merging perspectives from shared tool usage [User Query Addendum].
• Network Pattern (Horizontal): Network architectures feature agents communicating directly with one another in a many-to-many fashion, forming a decentralized structure without rigid hierarchical control.⁶⁵ Agents can initiate interactions with any other agent in the network. This architecture supports “collaborative reasoning” and can lead to “emergent intelligence,” where complex global behaviors arise from simpler local interactions. Pros include distributed collaboration, fault tolerance, and adaptability. Cons involve significant communication overhead, coordination challenges to avoid redundant effort or conflicting actions, and potential unpredictability of emergent behaviors, which can be problematic in regulated environments. Debugging complexity is also higher.⁶⁵ This pattern is considered optimal for creative synthesis and achieving robust emergence, for example, in tasks involving memory transformation and tool use [User Query Addendum].
• Hierarchical Pattern (Vertical): Hierarchical architectures organize agents in a tree-like structure, where higher-level “supervisor” agents coordinate and manage lower-level “worker” agents.⁶⁵ Information and control typically flow up and down this hierarchy. The reasoning paradigm is based on “supervision and delegation,” allowing complex tasks to be decomposed and managed through clear chains of command and responsibility. Pros include clear role division, streamlined communication, simplified governance, and scalability. Cons include potential single points of failure at upper levels, reduced autonomy for lower-level agents (which might stifle innovation), rigidity, and the possibility of upper-level agents becoming bottlenecks.⁶⁵ This pattern is best for modular task decomposition and hierarchical control [User Query Addendum].

2. Compositions: Human-in-the-loop, Shared Tools, Memory Transformation

Functional compositions refer to the integration of specific capabilities or operational modalities within MAS architectures, significantly influencing their behavior and effectiveness.

• Human-in-the-Loop (HITL): This composition involves integrating human oversight, verification, or intervention at critical junctures within the agent workflow.⁵⁹ HITL is crucial for tasks involving sensitive information, high-stakes decisions, or situations where AI performance may be unreliable. It allows for error correction, guidance, and helps build trust in AI systems. Modern MAS frameworks like LangGraph and AutoGen explicitly support HITL mechanisms, enabling humans to review agent actions, approve steps, or provide corrective feedback.⁹ The modularity of MAS facilitates the insertion of HITL checkpoints at known failure points or decision gates.⁵⁹
• Shared Tools: This composition enables multiple agents to access and utilize a common set of tools, which can include APIs, databases, computational functions, or specialized algorithms.⁵⁹ Sharing tools enhances the collective capabilities of the MAS, promotes efficiency by avoiding redundant tool implementations for each agent, and allows agents to leverage specialized functionalities beyond their core LLM. Orchestration is key to managing access to shared tools, resolving conflicts, and ensuring that tool outputs are correctly routed and utilized. Most contemporary MAS development frameworks, including LangGraph, AutoGen, and CrewAI, provide robust support for tool definition, integration, and invocation by agents.⁸
• Memory Transformation: This refers to the processes by which agents acquire, process, store, retrieve, and share memory or state information.⁵⁹ Effective memory management is vital for maintaining context across long interactions, enabling learning from past experiences, and supporting coherent multi-step reasoning. Memory can be transformed in various ways, such as distillation into summaries, structuring into knowledge graphs, or episodic recording of interactions. Different MAS frameworks offer distinct mechanisms for memory, including short-term (scratchpad) memory, long-term persistent memory, and shared memory spaces.⁹ Memory transformation is central to an agent system’s ability to learn and adapt its knowledge over time.

The selection of these architectural patterns and functional compositions is not merely a technical implementation detail; it is profoundly linked to the intended “cognitive load” and “epistemic function” of the Multi-Agent System. For instance, a Loop pattern, with its inherent iterative nature, is particularly well-suited for tasks that demand epistemic refinement, where knowledge or solutions are progressively improved through cycles of evaluation and adjustment.⁶⁵ This pattern embodies “reflective reasoning and self-improvement,” which are fundamentally epistemic functions. Similarly, a Hierarchical pattern directly facilitates distributed problem-solving by establishing clear lines of delegation and epistemic responsibility ⁶⁵; it implements “supervision and delegation models,” effectively distributing cognitive tasks and epistemic authority throughout the system. Functional compositions also carry cognitive implications: ‘Shared Tools’ can be viewed as shared epistemic resources that augment the collective intelligence of the system ⁵⁹, while ‘Memory Transformation’ is fundamental to how an agent system learns, adapts, and manages its knowledge base over time.¹⁹ Therefore, the choice of these primitives should be guided by a deep consideration of the desired cognitive behavior and epistemic capabilities of the MAS, aligning with the thesis’s objective to match MAS design with “task complexity and cognitive requirements” and to map patterns to “epistemic load.”

C. Tensions: Decentralization vs. Coordination Overhead; Memory Richness vs. State Management Complexity; Hierarchical Control vs. Emergent Behavior

The design of Multi-Agent Systems is characterized by a set of inherent tensions—fundamental trade-offs that architects must navigate. These tensions arise from competing design goals and the intrinsic properties of distributed intelligent systems.

1. Decentralization vs. Coordination Overhead:

A core tension in MAS design lies between the allure of decentralization and the burden of coordination overhead. Decentralized architectures, where agents possess significant autonomy and control is distributed, offer compelling advantages such as robustness to single-agent failures, enhanced scalability, and greater flexibility in adapting to dynamic environments.60 Each agent can operate with local views, making decisions based on its immediate context without needing a global system state. However, this autonomy comes at a price: achieving coherent collective behavior among decentralized agents requires sophisticated coordination mechanisms. This coordination—encompassing communication protocols, synchronization strategies, conflict resolution, and task allocation—can impose significant overhead in terms of message complexity, computational resources, and design effort.60 As Dr. Christopher Amato notes, understanding the trade-offs between coordination, scalability, and robustness shaped by communication approaches is key.68 Conversely, centralized systems, while simplifying coordination and providing a global view for optimization, often suffer from performance bottlenecks at the central controller and represent single points of failure, limiting scalability and resilience.68

2. Memory Richness vs. State Management Complexity:

Another critical tension involves the richness of agent memory versus the complexity of managing that state. Access to rich, persistent, and contextually relevant memory is fundamental for enabling sophisticated agent behaviors, such as long-term learning, context-aware reasoning, and adaptation based on past experiences.19 Agents that can remember and reflect on past interactions can build more accurate models of their environment and collaborators, leading to improved decision-making. However, endowing agents with rich memory capabilities introduces substantial state management complexity. This includes challenges in efficiently storing and retrieving large volumes of information, ensuring consistency across distributed memory stores (if memory is shared or communicated), preventing information overload, managing context decay, and defining effective memory update and transformation strategies.14 The more detailed and extensive the memory, the more intricate the mechanisms required to manage it, potentially impacting system performance and scalability.

3. Hierarchical Control vs. Emergent Behavior:

Finally, there is a tension between the desire for predictable, controllable behavior often afforded by hierarchical control structures, and the potential for novel, adaptive, and potentially more powerful solutions arising from emergent behavior in flatter, more decentralized network architectures. Hierarchical architectures, with clear lines of authority and task delegation, offer a structured approach to problem decomposition and facilitate predictable system operation.65 Control flows are well-defined, and responsibilities are clearly demarcated. However, such rigid structures can sometimes stifle innovation and limit the system’s ability to adapt to unforeseen circumstances. In contrast, networked architectures, where agents interact more freely and peer-to-peer, can foster emergent behaviors—complex global patterns arising from simple local interactions—that may lead to creative problem-solving and enhanced robustness.39 Yet, this emergence can also lead to unpredictability and make it harder to guarantee system alignment with overall goals, a particular concern with LLM-based agents known for their occasionally erratic behavior.1

These three tensions are not isolated but are often interconnected, forming a complex design trilemma. For instance, striving for rich memory in a highly decentralized system to foster complex emergent behavior can exponentially increase both coordination overhead (for sharing or synchronizing memory states) and state management complexity. Decentralized systems with numerous agents, each maintaining extensive, independent memory stores ¹⁹, would necessitate highly sophisticated protocols to manage and synchronize these distributed memories to ensure overall system coherence, thereby significantly increasing the coordination burden. Conversely, imposing hierarchical control might simplify state management by centralizing or structuring memory access and communication pathways, but this very control could inhibit the spontaneous, self-organizing interactions that often lead to valuable emergent behaviors.⁶⁵ Effectively, MAS designers must navigate a challenging trade-off space: a system designed for maximum decentralization and memory richness to achieve complex emergence will likely face the greatest hurdles in terms of coordination and state management. Conversely, a strictly hierarchical system with lean, tightly controlled memory might be simpler to manage and more predictable but could lack the adaptability and innovative potential of its more emergent counterparts. This intricate interplay underscores the critical need for a systematic framework, as proposed in this thesis, to provide principled guidance on balancing these competing factors based on the specific cognitive and epistemic requirements of the task at hand.

III. Methodological Core: A Design Science Approach to MAS Architecture

The development of a systematic architectural framework for multi-agent AI systems necessitates a robust methodological foundation. This research adopts a Design Science Research (DSR) approach, complemented by principles of Systems Thinking, to guide the creation and evaluation of MAS architectures.

A. Design Logic: Agentic Simulation and Architectural Testing Grounded in Design Science and Systems Thinking

The philosophical and methodological core of this thesis is anchored in Design Science Research (DSR). DSR is an appropriate paradigm as it is fundamentally concerned with the creation and evaluation of innovative artifacts intended to solve identified organizational or technical problems and improve existing solutions.⁷⁰ In this context, the primary artifacts are the proposed MAS architectural framework, the typology of MAS designs, and the MAS Pattern–Function Ontology (M-PFO). The research process, as outlined, aligns closely with DSR tenets: it begins with the identification of a clear research problem (the lack of a systematic MAS framework), sets forth the objective of a novel solution (a constructive design logic), and proceeds through phases of design, development (meta-architecture modeling), demonstration (recreation of canonical examples), and evaluation (comparative simulation and benchmarking). Recent work has indeed applied DSR methodologies to evaluate MAS prototypes through simulation and case studies.⁷⁰

A DSR methodology inherently implies an iterative process. This involves cycles of artifact creation (such as defining MAS architectural patterns or the M-PFO), followed by rigorous evaluation through simulation against predefined criteria (like performance and coherence), and subsequent refinement based on the evaluation outcomes. This iterative loop of building and testing directly supports the thesis’s central aim: to produce not just a descriptive categorization but a “constructive design logic” for MAS. The “comparative simulation and meta-architecture modeling” specified in the scope are clear indicators of this iterative, artifact-driven DSR approach. The development of a “systematic architectural framework” and a “typology” inherently involves the creation of novel, purposeful artifacts, which are then validated through the methodological core involving the recreation and testing of canonical examples.

Complementing DSR, Systems Thinking provides the essential conceptual lens for analyzing and understanding the intricate dynamics of MAS.⁷² MAS are complex adaptive systems where the behavior of the whole emerges from the interactions of its constituent agents. Systems Thinking encourages a holistic view, focusing on interconnections, feedback loops, and emergent properties rather than analyzing agents in isolation.⁷⁵ This perspective is crucial for diagnosing the “hidden complexity” and “emergent brittleness” identified in the research problem. By applying systems thinking, this research can move beyond evaluating isolated agent performance to understanding how architectural choices at the pattern level influence global system behavior, coordination efficiencies, and overall cognitive coherence. The emphasis in systems thinking on feedback mechanisms, emergence from local interactions, and holistic system understanding ⁷⁵ makes it an indispensable tool for analyzing the very issues this thesis seeks to address and for evaluating the comprehensive impact of the proposed architectural solutions.

B. Data & Cases: Recreate the 6 Canonical Examples of MAS

To empirically ground the comparative analysis of architectural patterns, this research will recreate and simulate six canonical examples of MAS. These examples, derived from empirical observation and common design patterns, represent a diverse set of functional compositions and interaction modalities prevalent in real-world MAS deployments. Their successful recreation and subsequent benchmarking across different architectural patterns will form a robust empirical basis for the proposed typology and the M-PFO. The selection of these examples is critical because they span a range of cognitive and operational demands, ensuring that the evaluation is comprehensive and the resulting framework is broadly applicable.

The six canonical examples are:

1. Hierarchical task decomposition: This involves a supervisor agent breaking down a complex problem (e.g., a multifaceted research query) into smaller, manageable sub-tasks, which are then delegated to specialized worker agents. The supervisor may then synthesize the results. Frameworks like CrewAI, with its explicit support for hierarchical processes and manager agents ¹⁰, LangGraph, which allows the construction of hierarchical agent teams via subgraphs and dynamic routing ⁸, and AutoGen, with its hierarchical chat capabilities ¹³, are well-suited for implementing this example.
2. Human-in-the-loop reasoning: This scenario incorporates human oversight and intervention within the agent workflow. For instance, an AI legal assistant might draft a contract, which is then reviewed, corrected, and approved by a human lawyer before finalization. LangGraph’s built-in statefulness and support for human approval steps ⁹, and AutoGen’s configurable human input modes ¹³, make them suitable for this example. Benchmarking such systems requires metrics that capture not only task success but also the efficiency of human-AI collaboration and user satisfaction.⁷⁶
3. Shared tools orchestration: Here, multiple agents access and utilize a common set of tools, such as a shared vector database for RAG, a suite of financial analysis APIs, or a code execution environment. Effective orchestration is needed to manage tool access, sequence tool calls, and handle tool outputs. All major MAS frameworks like LangGraph, AutoGen, and CrewAI provide extensive support for defining, integrating, and calling tools.¹¹ Evaluation focuses on correct tool invocation, parameter passing, and utilization of results.⁶⁷
4. Sequential pipeline agents: This example features a series of agents performing distinct processing steps in a defined order, such as a document analysis pipeline where an OCR agent extracts text, a summarization agent creates a digest, and a translation agent converts it to another language. LangGraph’s inherent graph-based structure naturally supports such pipelines ⁸, as does CrewAI’s sequential process model.¹⁰ Evaluation will consider flow integrity, error propagation through the pipeline, and the quality of the final output.⁸⁰
5. Database + tools integration: This involves agents interacting with structured databases (e.g., SQL) via natural language queries (often mediated by a tool) and then potentially using other tools to analyze, visualize, or act upon the retrieved data. The Manus AI system, with its specialized Planner, Execution, and Verification agents, provides an example of a multi-agent architecture handling complex tasks that could involve database interactions and subsequent tool use.⁵⁸
6. Memory-enabled tool reasoning: In this scenario, agents leverage memory of past interactions or retrieved information to refine their use of tools. For example, a research agent might use a tool to search a scientific database like ArXiv, remember which queries were successful or which papers were relevant in the past, and use this memory to formulate more effective future queries or to synthesize information over time. This requires tight integration of memory systems ⁵ with tool-use capabilities. AutoGen’s memory protocol, including options like ListMemory and ChromaDBVectorMemory for RAG ³⁴, and LangGraph’s flexible memory management ⁹, are relevant here.

The diversity of these six canonical examples—covering hierarchy, human oversight, resource sharing, pipelined processing, data-intensive operations, and adaptive learning through memory—ensures that the evaluation of architectural patterns is not confined to a narrow set of functionalities. Instead, it spans a broad spectrum of cognitive and operational demands typically placed on MAS. Successfully modeling and benchmarking these diverse cases will lend significant credibility to the generalizability and practical utility of the resulting architectural framework and the M-PFO.

C. Experimental Axis: Each Example Tested Across Multiple Patterns to Assess Task Success Rate, Reasoning Coherence, Latency and Throughput, Failure Modes

The core of the empirical investigation will involve a systematic cross-testing methodology. Each of the six canonical examples described above will be implemented using several different architectural patterns. For instance, the “Hierarchical task decomposition” example might be implemented not only using a formal Hierarchical pattern but also attempted with a Network pattern to observe if effective hierarchical control can emerge or if the lack of explicit structure leads to inefficiencies. This matrix-like approach—testing canonical application topologies against diverse architectural patterns—is a key methodological innovation. It allows for a nuanced understanding of pattern-topology fit, moving beyond the common practice of evaluating a single, fixed MAS implementation for a specific task. By decoupling the application type from the underlying architectural pattern, this study can isolate and analyze the effects of the pattern itself on performance and coherence for that particular class of task. This systematic comparison is essential for developing the “typology for optimal MAS design” and the “pattern–topology matrix” that are central aims of this research.

The performance of each pattern-example combination will be assessed along several critical axes:

• Task Success Rate: This will be measured as the degree to which the MAS achieves the primary goal of the given canonical example. This could be a binary outcome (success/failure) or a graded score based on the quality and completeness of the outcome.⁷⁷
• Reasoning Coherence: This metric assesses the logical consistency, soundness, and relevance of the system’s outputs and, where observable, its intermediate reasoning steps. Given the thesis’s aim to frame patterns as “cognitive schemas,” coherence is a vital indicator of the system’s “intellectual” performance. Evaluation may involve qualitative analysis of agent dialogues and decision rationales, and potentially quantitative measures based on logical consistency checks or alignment with expected reasoning pathways.⁸⁴
• Latency and Throughput: These are standard performance metrics. Latency will measure the time taken for the MAS to complete a given task or respond to a query. Throughput will measure the number of tasks or transactions the system can process per unit of time, where applicable.⁸⁴
• Failure Modes: A critical aspect of the evaluation will be the systematic identification, categorization, and analysis of how different pattern-topology combinations fail. This includes observing issues like coordination breakdowns, error propagation (e.g., hallucinations from one agent affecting others), tool misuse, inefficient resource allocation, or undesirable emergent behaviors. The Multi-Agent System Failure Taxonomy (MAST), which identifies 14 unique failure modes across categories like specification issues, inter-agent misalignment, and task verification/termination, will serve as a valuable reference for this analysis.⁶⁴

Based on the established characteristics of the architectural patterns ⁶⁵ and the specific demands of the canonical examples, the following hypotheses will be tested through simulation experiments:

• H1: For the Hierarchical task decomposition example, a Hierarchical pattern will demonstrate a higher task success rate and superior reasoning coherence compared to a flat Network pattern. However, the Hierarchical pattern may exhibit higher latency for simpler subtasks due to the communication overhead inherent in its structured command chain.
• H2: In the Human-in-the-loop reasoning example, a Sequential pattern that incorporates HITL checkpoints at key decision points will yield better interpretability and facilitate more effective error correction, leading to a higher final task success rate than a Parallel pattern where HITL is deferred to the end of the process. The Sequential HITL approach, however, is expected to increase overall latency.
• H3: For the Shared tools orchestration example, a Router pattern will more efficiently direct tasks to agents possessing the appropriate tools than a general Network pattern, particularly if the tool-task mapping is well-defined and stable. This should result in lower latency and higher tool utilization efficiency for the Router pattern.
• H4: In the Memory-enabled tool reasoning example, a Loop pattern that allows for iterative refinement of tool queries based on retrieved memory and intermediate results will achieve significantly higher task success rates and reasoning coherence for complex information retrieval tasks compared to a single-pass Sequential pattern using the same tools and memory.
• H5: For tasks involving the synthesis of diverse information, such as in some Shared tools orchestration scenarios, Aggregator patterns will improve the overall reasoning coherence of the final output by merging multiple perspectives or data points. However, this may introduce additional latency due to the aggregation step itself and any conflict resolution mechanisms required.

D. Instrumentation: Use Synthetic Benchmarks and Real-World RAG Tasks

The evaluation of MAS architectures will be conducted using a combination of synthetic benchmarks and real-world Retrieval-Augmented Generation (RAG) tasks. This dual approach is designed to provide a balanced assessment, testing both fundamental cognitive capabilities under controlled conditions and integrated system performance on practical, knowledge-intensive problems.

Synthetic Benchmarks: These will involve tasks constructed to specifically test core reasoning capabilities, such as multi-hop question answering, logical deduction, or planning, often over large, structured corpora like selected subsets of Wikipedia.⁵⁶ For instance, a multi-hop QA benchmark might require agents to synthesize information from multiple Wikipedia articles to answer a complex question, with the number of hops or the ambiguity of the required information being systematically varied to assess performance under different levels of difficulty.⁸⁶ Such benchmarks allow for the controlled isolation and measurement of specific reasoning abilities, providing insights into the fundamental strengths and weaknesses of different architectural patterns in supporting these cognitive functions.

Real-World RAG Tasks: To assess practical applicability, the MAS configurations will also be evaluated on RAG tasks that mirror real-world use cases.⁵⁶ These tasks will require agents to retrieve relevant information from a domain-specific knowledge base (e.g., a corpus of legal documents, a collection of scientific papers, or extensive technical manuals) and then use this retrieved information to generate coherent responses, analyses, or solutions. Examples could include summarizing recent research findings on a specific topic based on a database of ArXiv papers (as in the HM-RAG and arXiv title-to-abstract inference tasks ⁸⁷), or drafting a legal memo based on retrieved case law. These RAG tasks will test the MAS’s ability to effectively integrate information retrieval, knowledge synthesis, and generation, which are crucial for the “autonomous research” and “knowledge synthesis” applications highlighted as significant in the thesis proposal.

The combination of these instrumentation strategies ensures that the findings of this research are both theoretically sound, derived from controlled synthetic tests, and practically relevant, validated through performance on realistic RAG tasks. This balanced evaluation strengthens the overall validity and applicability of the proposed MAS design framework and the M-PFO.

IV. Synthesis and Implications: Towards a Constructive Framework

This section synthesizes the findings from the theoretical review and empirical evaluations, drawing connections between architectural patterns, application characteristics, and performance outcomes. The aim is to move beyond descriptive analysis towards a constructive framework for MAS design, culminating in the proposal of the MAS Pattern–Function Ontology (M-PFO).

A. Discussion

1. Meta-mapping of Patterns to Applications: Which Topologies Work Best Under Which Epistemic Load?

The experimental testing of the six canonical examples across various architectural patterns (as detailed in Section III.C) will yield a rich dataset. This data will be synthesized to create a meta-map, likely in the form of a detailed matrix or a descriptive model. This map will illustrate the performance and suitability of the seven key architectural patterns (Parallel, Sequential, Loop, Router, Aggregator, Network, Hierarchical) when applied to the different application topologies represented by the canonical examples. A crucial dimension of this mapping will be the concept of “epistemic load.” Epistemic load refers to the nature and complexity of the knowledge processing demands placed upon the MAS, including the intricacy of reasoning required, the volume and diversity of knowledge to be integrated, the level of uncertainty to be managed, and the degree of self-correction or learning expected.

For example, a task with high epistemic load might involve synthesizing novel insights from conflicting sources of information under uncertainty, requiring iterative refinement and complex reasoning. In contrast, a task with low epistemic load might involve a straightforward, deterministic sequence of operations on well-structured data. The meta-map will articulate which architectural patterns are most effective under varying degrees and types of epistemic load. For instance, Network patterns might excel in tasks requiring creative synthesis from diverse inputs (high epistemic load related to novelty and integration), while Sequential patterns might be optimal for tasks requiring verifiable, step-by-step processing of information with lower ambiguity (lower epistemic load regarding uncertainty management). The initial Pattern–Example Concordance Table provided in the research proposal serves as a foundational hypothesis for this meta-map, which will be refined and substantiated by the empirical results. Insights from literature on MAS complexity, task decomposition, coordination strategies ⁶, and architectural pattern selection criteria ³³ will inform the interpretation of these findings.

2. Emergent Design Principles

From the detailed meta-mapping of patterns to applications under varying epistemic loads, several generalizable design principles are expected to emerge. These principles will offer actionable guidance for MAS architects. The preliminary principles suggested in the research proposal, derived from the inherent characteristics of the patterns ⁶⁵, include:

• Loop patterns for iterative epistemic refinement: The inherent structure of a Loop pattern, facilitating repeated cycles of processing and feedback, makes it highly suitable for tasks requiring self-correction, accuracy improvement through iteration, or progressive deepening of understanding (e.g., memory transformation for enhanced recall).⁶⁵ This aligns with tasks where the epistemic goal is to refine knowledge or solutions over time.
• Router patterns for tool-rich environments: In scenarios where an MAS has access to a diverse array of specialized tools, a Router pattern provides an efficient mechanism for dynamic task assignment. The router, acting as a decision point, can direct specific sub-tasks or queries to the agent(s) equipped with the most appropriate tool(s), optimizing resource utilization and processing pathways.⁶⁵ This is particularly effective when the epistemic function involves selecting the correct knowledge source or processing capability from many options.
• Hierarchical patterns for modular reasoning: When a complex problem can be decomposed into relatively independent sub-problems, a Hierarchical pattern offers a clear structure for modular reasoning. It allows for the delegation of sub-tasks to specialized agents and the structured aggregation of results, maintaining clarity of roles and responsibilities.⁶⁵ This supports epistemic tasks that benefit from clear decomposition and specialized expertise.
• Network patterns for creative synthesis and redundancy: The decentralized and flexible nature of Network patterns fosters emergent collaboration and information exchange among agents. This can be highly beneficial for tasks requiring creative synthesis of diverse information or for achieving robust and resilient solutions through inherent redundancy, as multiple agents or pathways can contribute to the outcome.⁶⁵ This pattern supports epistemic goals related to novelty generation and robust knowledge discovery in complex spaces.

These initial principles will be rigorously tested and refined based on the simulation results, leading to a more nuanced and empirically grounded set of guidelines for MAS design.

3. Trade-off Matrices: Latency vs. Coherence; Fault Tolerance vs. Interpretability. Suggest Metrics for Evaluating the Scalability of Different MAS Architectures, Beyond Latency, Fault Tolerance, and Coherence.

The selection of an MAS architecture invariably involves navigating trade-offs between competing performance characteristics. To make these trade-offs explicit, trade-off matrices will be developed. These matrices will visually represent how different architectural patterns perform against key metrics such as latency (speed of execution), coherence (logical consistency and quality of reasoning), fault tolerance (robustness to agent or component failure), and interpretability (ease of understanding the system’s decision-making process). For example, a Network pattern might offer high fault tolerance due to its decentralized nature but may suffer from higher latency due to coordination overhead and lower interpretability due to complex emergent interactions.⁶ Conversely, a Sequential pattern might offer high interpretability and potentially lower latency for simple tasks but exhibit lower fault tolerance.

Beyond these standard metrics, evaluating the scalability of MAS architectures requires a more nuanced approach. Scalability in MAS is not merely about handling more agents or data with acceptable latency and fault tolerance; it also concerns the system’s ability to maintain and enhance its collective intelligence and adaptability as complexity grows. The following advanced scalability metrics are proposed, drawing inspiration from recent literature ⁶¹:

• Cognitive Load Scalability: This measures how well an architecture scales concerning the cognitive burden on individual agents (e.g., complexity of decision-making, amount of state to maintain) and on any central orchestrator or supervisor agent as the overall task complexity or number of agents increases. Indicators could include decision-making time per agent, communication overhead specifically for coordination purposes, and error rates of individual agents under increasing cognitive demands.⁶
• Knowledge Scalability (Epistemic Bandwidth): This assesses the MAS’s capacity to effectively integrate, manage, and utilize growing volumes of knowledge without a proportional degradation in reasoning quality, decision speed, or coherence. Metrics could include the precision and recall of RAG systems at scale, the efficiency of context window utilization by LLM-based agents, and the time taken to incorporate and leverage new knowledge sources.
• Task Decomposition Efficiency: As tasks become more complex, this metric evaluates how efficiently an architecture can decompose them into manageable sub-tasks, distribute these sub-tasks to appropriate agents, and then effectively reintegrate the partial results. Measures might include the depth and breadth of effective task decomposition achievable, the overhead associated with managing sub-task dependencies and communication, and the quality of the synthesized final output.
• Adaptive Capacity / Learning Scalability: This refers to how well the system’s learning rate or its ability to adapt to new situations or changing environmental dynamics scales with an increasing number of agents, greater task complexity, or a larger volume of experience data. Indicators could be the rate of improvement on benchmark tasks over time as the system scales, the convergence speed of any collective learning algorithms, or the system’s ability to generalize learned behaviors to novel scenarios of increasing complexity.
• Economic Scalability / Resource Efficiency: This considers the cost (computational resources, API call costs for LLMs, energy consumption) per successfully completed task or per unit of value generated, as the system scales in terms of agents or workload.⁶¹
• Communication Protocol Scalability: This assesses the efficiency and robustness of the inter-agent communication mechanisms as the number of agents and the intensity of interactions grow. Metrics could include average message overhead, susceptibility to network congestion, and limitations imposed by the chosen communication protocols or languages.⁶¹
• Extensibility and Modularity: This qualitative and potentially quantitative metric evaluates the ease with which new agents, tools, or functional capabilities can be added to the system without requiring significant redesign or causing a disproportionate decrease in performance or coherence.⁶¹

True MAS scalability, therefore, is a multifaceted concept that extends beyond mere computational performance to encompass these cognitive, epistemic, and economic dimensions. Standard metrics like latency and throughput measure operational efficiency but do not fully capture the system’s ability to scale its collective intelligence or adaptability. Fault tolerance addresses robustness to component failure but not necessarily the system’s capacity to handle increasing cognitive complexity or information overload. While coherence is vital, maintaining it under scaled conditions (more agents, more diverse knowledge sources) presents unique challenges not fully reflected by coherence scores in smaller, simpler systems. The proposed advanced metrics aim to capture these deeper aspects of how well the intelligence, adaptability, and knowledge processing capabilities of the MAS scale, which is crucial for the cognitive reframing central to this thesis.

4. Analyze the Computational Complexity of Different MAS Patterns and Their Implications for Real-Time Applications.

Each MAS architectural pattern possesses an inherent computational complexity profile, influenced by factors such as the number of agents, the volume and frequency of inter-agent communication, the complexity of decision-making within individual agents (especially for coordinating roles like routers or schedulers), and synchronization costs.

• Parallel Pattern: The complexity can be related to the most complex sub-task if agents work truly independently. However, if outputs need aggregation or there are dependencies, the complexity of the coordination and aggregation logic (O(N) or higher for N agents) adds to this. Communication for synchronization can also be a factor.
• Sequential Pattern: The total complexity is largely the sum of the complexities of individual agent stages. Bottlenecks are determined by the most complex stage. Communication is typically point-to-point, adding linearly to overhead.
• Loop Pattern: Complexity depends on the complexity of each iteration and the number of iterations required for convergence or termination. If the number of iterations is unbounded or highly variable, predicting computational load is difficult.
• Router Pattern: The router agent’s decision-making complexity can be significant, potentially O(N) or O(logN) depending on the routing logic and number of available agents/paths. Overall complexity also includes the chosen path’s complexity.
• Aggregator Pattern: The aggregation step itself can have complexity ranging from O(N) (simple averaging) to much higher if complex conflict resolution or synthesis algorithms are used.
• Network Pattern: Communication complexity can be high, potentially O(N2) in dense networks if all agents can communicate with all others. Coordination without a central authority can lead to complex, emergent dynamics whose computational demands are hard to predict.
• Hierarchical Pattern: Communication is typically structured (parent-child). The complexity at each level depends on the number of subordinates and the tasks of supervisor agents. Bottlenecks can occur at higher levels if supervisors are overwhelmed. Total complexity involves summing complexities across levels, with coordination overhead at each supervisory node.

Some research explores heuristic approaches like genetic algorithms or neural networks for planning and optimization within MAS, each carrying its own computational complexity characteristics.⁹³ Other works touch upon complexity in specific contexts like traffic forecasting or channel estimation ⁹⁴, and even quantum-classical hybrid techniques for routing problems, indicating the non-trivial nature of these calculations.⁹⁶

Implications for Real-Time Applications:

The computational complexity of a chosen pattern has direct implications for its suitability in real-time applications (e.g., autonomous vehicles, robotic control, high-frequency trading), which demand predictable performance and strictly bounded latencies.

• Patterns with high or unpredictable communication overhead (e.g., dense Network patterns) or those with potentially unbounded iterative loops (some Loop patterns) may struggle to meet real-time constraints.
• Centralized bottlenecks in Router or Hierarchical patterns could also jeopardize real-time responsiveness if the central/supervisory agent becomes overloaded.
• Sequential and simpler Parallel patterns, where sub-task complexities are well-understood and communication is constrained, might offer more predictable behavior and thus be more amenable to worst-case execution time (WCET) analysis, which is critical for real-time guarantees.

A direct trade-off often exists between the expressive power or adaptive flexibility of an MAS pattern and its predictable computational complexity for real-time deployment. Highly dynamic or decentralized patterns like the Network pattern may offer superior adaptability to unforeseen situations but pose significant challenges for the kind of WCET analysis required for safety-critical real-time systems. Therefore, the selection of an MAS pattern for such applications must carefully balance the need for sophisticated coordination and intelligence with the stringent requirement for predictable and bounded computational behavior. This represents a critical practical implication of the theoretical framework being developed.

B. Conclusion

1. Return to Aim: Not Just Categorization but Constructive Design Logic.

This research set out with the ambitious aim to move beyond a mere categorization of Multi-Agent System architectural patterns. The goal was to articulate, test, and formalize a constructive design logic that empowers architects and developers to build more effective, coherent, and task-aligned MAS. Through a systematic review of MAS evolution, a critical survey of architectural primitives, an empirical investigation of canonical use cases across diverse patterns, and a synthesis of performance characteristics, this thesis has laid the groundwork for such a constructive approach. The findings from the meta-mapping of patterns to applications, the articulation of emergent design principles, and the analysis of inherent trade-offs collectively contribute to a more principled understanding of how to design agentic systems not just as functional toolchains, but as robust cognitive and epistemic infrastructures.

2. Propose a MAS Pattern–Function Ontology (M-PFO). Explore Potential Limitations of the Proposed M-PFO and Suggest Ways to Address Them.

To formalize the relationship between MAS architecture and its intended purpose, this thesis proposes the Multi-Agent System Pattern–Function Ontology (M-PFO). The M-PFO is conceptualized as a formal ontology that systematically maps MAS architectural patterns (e.g., Hierarchical, Loop, Network) and common functional compositions (e.g., Shared Tools, Human-in-the-Loop, Memory Transformation) to the higher-level cognitive and epistemic functions they are best suited to support (e.g., “Iterative Knowledge Refinement,” “Distributed Problem Solving,” “Dynamic Resource Allocation,” “Perspective Merging,” “Modular Task Decomposition”). This ontology will be directly informed by the empirical findings from the comparative simulations (Section III.C), the emergent design principles (Section IV.A.2), and the pattern-application meta-map (Section IV.A.1). The M-PFO aims to serve as a structured knowledge base, enabling designers to make more informed, less heuristic choices when selecting architectural components for their MAS, based on the specific cognitive or epistemic requirements of the intended application.

Despite its potential utility, the proposed M-PFO is subject to several inherent limitations:

• Granularity and Abstraction: Defining the appropriate level of granularity for both patterns and functions is challenging. If too coarse, the ontology may lack practical specificity; if too fine, it may become overly complex and difficult to navigate or generalize from.
• Completeness: The initial version of the M-PFO will inevitably be incomplete. The MAS field, particularly with the rapid advancements in LLM-based agents, is constantly evolving, with new patterns, compositions, and functional capabilities emerging.⁶⁴ Capturing all existing nuances and anticipating all future developments is an ongoing challenge.
• Context-Sensitivity: The optimal mapping between a pattern and a function is often highly dependent on the specific context, including the nature of the task, the domain of application, the capabilities of the underlying LLM or agent platform, and the specific quality attributes being prioritized (e.g., latency vs. coherence). A static ontology may struggle to adequately represent this dynamic context-sensitivity.
• Representation of Emergence: Truly emergent functions—those that arise unpredictably from the complex interactions within an MAS rather than being explicitly designed into a pattern—are notoriously difficult to capture within a formal ontological structure. The M-PFO might only be able to indicate a “potential for emergence” associated with certain patterns (like Network) rather than defining specific emergent functions.
• Validation: Rigorously validating the completeness, correctness, and practical utility of the M-PFO is a significant methodological challenge. It requires more than just internal consistency checks; it needs empirical validation through application in real-world design scenarios.
• Adoption and Maintenance: For the M-PFO to have a lasting impact, it needs to be adopted by the research and development community. This requires clear documentation, accessible tools, and a sustainable plan for its ongoing maintenance and evolution as the field progresses.

To address these limitations, the following strategies are suggested:

• Granularity: The M-PFO should be developed with a hierarchical structure, allowing for multiple levels of abstraction for both patterns and functions, catering to different user needs.
• Completeness and Evolution: The M-PFO should be designed as an extensible and versioned framework. Mechanisms for community contributions, peer review, and regular updates based on new research and empirical findings should be established. Automated methods, such as text mining of MAS literature or analysis of open-source MAS code repositories, could be explored to identify and suggest new patterns, functions, or relationships.
• Context-Sensitivity: The ontology could incorporate contextual parameters or conditional relationships. For example, a mapping might state: “Pattern X supports Function Y under condition Z (e.g., high data volume, real-time constraint).” This allows for more nuanced recommendations.
• Emergence: While direct ontological representation of specific emergent functions is hard, the M-PFO can include meta-constructs like “supports high emergence potential” or link patterns to well-documented classes of emergent behaviors without over-specifying the function itself.
• Validation: Validation should be multi-pronged: expert reviews by MAS researchers and practitioners, application in controlled design case studies to assess its impact on design choices and outcomes, and empirical testing (e.g., comparing the performance of systems designed with M-PFO guidance versus those designed heuristically).
• Adoption and Maintenance: Dissemination through publications, workshops, and open-source releases is crucial. Providing software tools, libraries, or plugins for popular MAS development environments that integrate or reference the M-PFO would significantly lower the barrier to adoption. A dedicated working group or community effort could oversee its maintenance.

The primary value of the M-PFO lies in its potential to act as a shared, structured conceptual model. It aims to bridge the existing gap between abstract architectural patterns and the concrete cognitive or epistemic requirements of complex AI tasks, thereby fostering a more principled, systematic, and less heuristic approach to MAS design. This directly addresses the “Micro Gap” identified earlier, which highlighted the lack of systematic comparison and pattern use.⁴¹ By explicitly linking patterns to “cognitive requirements” [User Query Aim], the M-PFO directly supports the thesis’s overarching goal of reframing MAS as cognitive schemas. However, its inherently static nature will always be challenged by the dynamic and rapid evolution of MAS capabilities, particularly those driven by LLMs.³ Therefore, the M-PFO must be envisioned not as a final, immutable artifact, but as a “living document” or evolving knowledge base, equipped with robust mechanisms for continuous adaptation and refinement to maintain its relevance and utility in this fast-paced field.

3. Identify Generalizable Architectural Motifs for Task-Aligned MAS Design.

Building upon the M-PFO and the empirical findings, this research will identify and articulate generalizable architectural motifs. These motifs represent higher-level, recurring combinations of architectural patterns and functional compositions that have demonstrated particular effectiveness for specific classes of tasks or epistemic goals. They are, in essence, proven “meta-patterns” or design templates that MAS architects can adapt and instantiate.

Examples of such motifs might include:

• The “Iterative Refinement Engine”: Combining a Loop pattern with Memory Transformation (for storing and updating intermediate states or knowledge) and potentially Human-in-the-Loop (for feedback or validation). This motif would be highly effective for tasks requiring progressive improvement of a solution, self-correction, or deep exploration of a problem space (e.g., complex query answering, scientific hypothesis generation).
• The “Dynamic Expert Consultation System”: Integrating a Router pattern (to select appropriate specialized agents) with Shared Tools (providing access to domain-specific knowledge bases or analytical capabilities) and a Hierarchical pattern (if sub-specialists are involved). This motif would suit scenarios requiring dynamic access to diverse expertise for complex decision-support or problem-solving (e.g., a medical diagnostic assistant consulting different specialist agents).
• The “Robust Distributed Sensemaker”: Employing a Network pattern (for broad information gathering and diverse perspective generation) with an Aggregator pattern (to synthesize findings and achieve consensus or a multi-faceted understanding) and robust Fault Tolerance mechanisms. This motif would be ideal for tasks involving sensemaking in complex, uncertain environments or for generating creative solutions through the amalgamation of many viewpoints (e.g., market trend analysis, collaborative knowledge discovery).

These motifs, grounded in empirical evidence and formalized through the M-PFO, will provide designers with readily applicable, task-aligned architectural starting points, further contributing to the constructive design logic this thesis aims to deliver.

C. Recommendations

Based on the findings of this research, several recommendations can be made for researchers, engineers, and theorists working in the domain of Multi-Agent Systems.

1. For Researchers: Further Study on Agentic Memory Governance and Context Window Fusion.

Two critical areas demand further research to unlock the full potential of advanced MAS, particularly LLM-based ones: agentic memory governance and context window fusion.

• Agentic Memory Governance: As agents become more autonomous and operate over longer durations, the management of their individual and collective memories becomes paramount.⁵ Research is needed into sophisticated memory governance mechanisms. This includes strategies for:

• Selective Retention and Forgetting: How can agents intelligently decide what information is crucial to retain in long-term memory and what can be safely discarded to avoid cognitive overload or performance degradation?
• Knowledge Consistency: In systems with distributed memories, how can consistency be maintained across agents, and how should conflicts arising from differing memory states be resolved?
• Access Control and Privacy: For agents handling sensitive information, how can memory access be governed to ensure privacy and security, especially in multi-tenant or collaborative environments?
• Memory Summarization and Abstraction: Techniques for agents to create efficient summaries or abstractions of their experiences or learned knowledge to share with others or for more efficient internal reasoning.
• Context Window Fusion: LLMs, which often form the cognitive core of modern agents, operate with fixed-size context windows.⁹⁰ In an MAS where multiple agents generate and exchange information, effectively managing what information is presented to an LLM within its context window at any given time is a critical challenge.⁹⁰ Future research should focus on dynamic context window fusion techniques. This involves developing methods to:

• Prioritize and Select Information: Intelligently select the most relevant pieces of information from various agents or knowledge sources to include in the LLM’s context for a specific task or decision.
• Compress and Summarize Context: Develop techniques to compress or summarize information from multiple sources into a concise form that fits within the context window while retaining essential meaning.
• Fuse Multi-Modal Context: For agents dealing with information from different modalities (text, images, structured data), methods are needed to effectively fuse this diverse contextual information for holistic understanding by the LLM.

Effective memory governance and context fusion are fundamental prerequisites for achieving scalable and coherent collective intelligence in LLM-MAS. Without significant advancements in these areas, LLM-MAS will struggle to overcome the inherent limitations of individual agent memory capacities and the constraints of LLM context windows, thereby limiting their ability to tackle increasingly complex, long-running, and knowledge-intensive tasks.

2. For Engineers: Adoption of Adaptive Orchestration Layers with Switchable Patterns.

The empirical findings of this thesis are expected to show that the optimal MAS architectural pattern is often not static but can vary depending on the specific phase of a task, the nature of the data being processed, or the current state of the environment. Therefore, a key recommendation for engineers building MAS is to move towards adaptive orchestration layers that support dynamic switching or blending of coordination patterns.

Current MAS frameworks often require designers to commit to a primary architectural pattern (e.g., hierarchical or sequential) at design time. However, a complex problem-solving process might benefit from different patterns at different stages: parallel processing for initial data gathering, a sequential pipeline for analysis, a loop for iterative refinement, and a hierarchical structure for final decision-making and action.

Engineers should explore and adopt frameworks that enable:

• Dynamic Pattern Reconfiguration: The ability for the MAS or a meta-level orchestrator to change the dominant coordination pattern among a group of agents in response to evolving task requirements or performance feedback. For example, if a hierarchical approach leads to a bottleneck, the system might temporarily switch to a more networked or parallel mode for a specific sub-task.
• Hybrid Pattern Implementations: Designing systems that simultaneously leverage elements from multiple patterns in a fluid manner.
• Learning-Based Orchestration: Developing orchestrators that can learn which patterns or coordination strategies are most effective for different types of sub-tasks or contexts over time, potentially using reinforcement learning or other adaptive techniques.⁹⁷ LangGraph’s “Command” feature, which allows nodes to dynamically specify the next node in the graph, represents a step towards more dynamic flow control and could be extended for pattern switching.⁸

The development of such adaptive orchestration layers would allow MAS to be significantly more flexible, efficient, and robust across a wider range of complex, multi-stage tasks. This adaptability mirrors how a sophisticated cognitive system might shift its mode of thought or problem-solving strategy depending on the nature of the challenge it faces.

3. For Theorists: Reframing MAS as Distributed Epistemic Actors Rather Than Execution Pipelines.

This thesis argues for a fundamental reframing of Multi-Agent Systems, urging theorists to move beyond the conception of MAS as mere execution pipelines and instead to conceptualize them as distributed epistemic actors. This shift in perspective involves viewing MAS as collective entities that engage in processes of perception, reasoning, learning, belief formation, knowledge sharing, and action, all in pursuit of epistemic goals—such as achieving a more accurate understanding of a complex phenomenon, generating novel hypotheses, or synthesizing disparate pieces of information into coherent knowledge.

This reframing, which is a core theme of this research and finds resonance in work on cognitive MAS and the role of artifacts in their environments ³⁹ as well as discussions on distributed epistemic reasoning ⁹⁹, has several important implications for theoretical development:

• Focus on Collective Cognition: It encourages a focus on how collective cognitive capabilities (e.g., distributed sensemaking, collaborative problem-solving, group learning) emerge from the interactions of individual agents and the architectural patterns that structure these interactions.
• Epistemological Questions: It brings to the fore crucial epistemological questions within MAS, such as: How is knowledge represented and shared in a distributed manner? How are conflicting beliefs or evidence reconciled? How is trust established among agents? What are the mechanisms for collective belief revision or theory change within an agent society?
• Normative Aspects of Reasoning: It invites exploration of normative aspects of distributed reasoning. What constitutes “good” or “rational” collective reasoning in an MAS? How can we design MAS that adhere to certain epistemic virtues like coherence, justification, and truth-aptness?
• Understanding Emergent Epistemic Properties: It drives research into how desirable epistemic properties (e.g., the ability to generate truly novel insights, the resilience of collective knowledge to misinformation) can emerge from the system’s architecture and interaction protocols.

Viewing MAS as distributed epistemic actors, rather than just optimized task executors, shifts the research agenda from primarily focusing on efficiency and task completion metrics towards understanding and fostering the mechanisms of collective knowledge creation, robust reasoning under uncertainty, and adaptive learning within the agent society. This perspective aligns with the overarching goal of this thesis to provide a deeper, more generative understanding of intelligence as it manifests in distributed AI systems.

4. Explicitly Identify Potential Ethical Considerations Related to the Deployment of Autonomous MAS, Especially in Critical Domains (Legal AI, Autonomous Research, Knowledge Synthesis).

The increasing autonomy, complexity, and distributed nature of MAS, particularly LLM-MAS with their inherent unpredictability and opacity, introduce a host of novel and amplified ethical considerations. These concerns become especially acute when such systems are deployed in critical domains like legal AI, autonomous scientific research, and large-scale knowledge synthesis, where errors, biases, or misalignments can have severe and far-reaching consequences.⁴⁸

Key ethical considerations that must be proactively addressed include:

• Accountability and Responsibility: In a distributed system of interacting autonomous agents, determining who is responsible when the MAS produces a harmful outcome (e.g., flawed legal advice, erroneous research findings, biased knowledge synthesis) becomes exceptionally challenging. Traditional notions of accountability are difficult to apply when decisions emerge from the complex interplay of multiple agents, their programming, their learned behaviors, and their interaction protocols.¹⁰⁰ Clear frameworks for assigning and auditing responsibility are needed.
• Bias Amplification and Emergence: Individual agents, especially if LLM-based, may inherit biases from their training data. In an MAS, these individual biases can be amplified, compounded, or interact in unpredictable ways to create new, emergent collective biases.¹⁰⁰ Rigorous methods for auditing, detecting, and mitigating bias at both individual agent and system levels are essential.
• Misinformation and Hallucination Propagation: LLM-based agents are prone to generating plausible but false or unsubstantiated information (hallucinations).¹ In an MAS, if one agent produces such misinformation, it can be accepted as valid input by other agents, leading to its propagation and reinforcement throughout the system, potentially corrupting the collective knowledge base or leading to flawed conclusions. The concept of “infectious malicious prompts” further highlights how intentionally harmful instructions can spread within an MAS.¹⁰¹
• Opacity and Lack of Explainability: As MAS grow in complexity, their collective decision-making processes can become increasingly opaque, even if individual agent behaviors are somewhat understandable. This lack of transparency challenges the ability to trust the system’s outputs, debug errors, and ensure alignment with human intentions, which is particularly problematic in critical domains requiring justifiable decisions.¹⁰⁰
• Unforeseen Harmful Emergent Behavior: The potential for complex MAS to exhibit unforeseen and potentially harmful emergent behaviors that were not explicitly programmed or anticipated by designers is a significant concern. This risk is magnified by the adaptive and learning capabilities of agents.
• Data Privacy and Security: MAS, especially those involved in autonomous research or legal AI, may process vast amounts of sensitive, proprietary, or personal data. Ensuring the privacy and security of this data as it is accessed, shared, and processed by multiple autonomous agents, potentially across different administrative domains, is a critical challenge.¹⁰⁰
• Deskilling and Over-reliance: In domains like legal analysis or scientific research, the widespread deployment of highly autonomous MAS could lead to the deskilling of human experts if they become overly reliant on these systems and cede critical judgment and analytical tasks.
• Value Alignment: Ensuring that the collective goals, emergent behaviors, and decision-making criteria of the MAS remain aligned with human values, ethical principles, and the specific normative standards of the domain (e.g., legal ethics, scientific integrity) is an ongoing and complex challenge.⁴⁸

The increased autonomy and distributed nature of MAS introduce ethical challenges that are qualitatively different and often more complex than those associated with single-agent or monolithic AI systems. The interaction between multiple agents can lead to cascading failures or emergent phenomena that are difficult to predict and control.¹ Critical domains such as legal AI, autonomous research, and knowledge synthesis demand exceptionally high degrees of accuracy, reliability, and trustworthiness. The potential for amplified bias, propagated errors, or opaque reasoning within MAS poses significant risks in these areas. Therefore, ethical frameworks for MAS must be developed to address not only the behavior of individual agents but also the ethical implications of the collective system and its emergent properties. This requires ongoing dialogue between AI researchers, ethicists, domain experts, policymakers, and the public.

V. Addendum: Pattern–Example Concordance Table (Summary)

The following table provides a high-level summary of the anticipated best-fit examples for each primary Multi-Agent System architectural pattern, along with the principal design goal typically associated with that pairing. This concordance is based on the initial understanding of pattern strengths and will be further refined and validated through the empirical investigations detailed in this thesis.

Geciteerd werk

1. arxiv.org, geopend op mei 21, 2025, https://arxiv.org/abs/2502.01714
2. Position: Towards a Responsible LLM-empowered Multi-Agent Systems – arXiv, geopend op mei 21, 2025, https://arxiv.org/pdf/2502.01714
3. LLM-based Multi-Agent Systems: Techniques and Business Perspectives – arXiv, geopend op mei 21, 2025, https://arxiv.org/html/2411.14033v2
4. Survey on Evaluation of LLM-based Agents – arXiv, geopend op mei 21, 2025, https://arxiv.org/html/2503.16416v1
5. arxiv.org, geopend op mei 21, 2025, https://arxiv.org/html/2504.18875v1
6. Advancing Multi-Agent Systems Through Model Context Protocol: Architecture, Implementation, and Applications – arXiv, geopend op mei 21, 2025, https://arxiv.org/html/2504.21030v1
7. Build multi-agent systems with LangGraph and Amazon Bedrock – AWS, geopend op mei 21, 2025, https://aws.amazon.com/blogs/machine-learning/build-multi-agent-systems-with-langgraph-and-amazon-bedrock/
8. Command: A new tool for building multi-agent architectures in …, geopend op mei 21, 2025, https://blog.langchain.dev/command-a-new-tool-for-multi-agent-architectures-in-langgraph/
9. LangGraph – LangChain, geopend op mei 21, 2025, https://www.langchain.com/langgraph
10. The Friendly Developer’s Guide to CrewAI for Support Bots …, geopend op mei 21, 2025, https://www.cohorte.co/blog/the-friendly-developers-guide-to-crewai-for-support-bots-workflow-automation
11. What is crewAI? | IBM, geopend op mei 21, 2025, https://www.ibm.com/think/topics/crew-ai
12. AutoGen 0.4 Tutorial – Create a Team of AI Agents (+ Local LLM w/ Ollama), geopend op mei 21, 2025, https://www.gettingstarted.ai/autogen-multi-agent-workflow-tutorial/
13. Multi-agent Conversation Framework | AutoGen 0.2, geopend op mei 21, 2025, https://microsoft.github.io/autogen/0.2/docs/Use-Cases/agent_chat/
14. AI Agent Workflows: A Complete Guide on Whether to Build With LangGraph or LangChain, geopend op mei 21, 2025, https://towardsdatascience.com/ai-agent-workflows-a-complete-guide-on-whether-to-build-with-langgraph-or-langchain-117025509fa0/
15. Agent architectures – GitHub Pages, geopend op mei 21, 2025, https://langchain-ai.github.io/langgraph/concepts/agentic_concepts/
16. Are there any repos for complex agent architecture Examples using Langgraph – Reddit, geopend op mei 21, 2025, https://www.reddit.com/r/LangChain/comments/1jk53h8/are_there_any_repos_for_complex_agent/
17. Multi-Agent System Tutorial with LangGraph – FutureSmart AI Blog, geopend op mei 21, 2025, https://blog.futuresmart.ai/multi-agent-system-with-langgraph
18. LangGraph – GitHub Pages, geopend op mei 21, 2025, https://langchain-ai.github.io/langgraph/
19. Long-Term Agentic Memory with LangGraph – Saptak Sen, geopend op mei 21, 2025, https://saptak.in/writing/2025/03/23/mastering-long-term-agentic-memory-with-langgraph
20. LangGraph Tutorial: A Comprehensive Guide to Building Advanced AI Agents, geopend op mei 21, 2025, https://dev.to/aragorn_talks/langgraph-tutorial-a-comprehensive-guide-to-building-advanced-ai-agents-l31
21. CrewAI | Phoenix – Arize AI, geopend op mei 21, 2025, https://docs.arize.com/phoenix/learn/agents/agent-workflow-patterns/crewai
22. Running multi agents in parallel – Crews – CrewAI, geopend op mei 21, 2025, https://community.crewai.com/t/running-multi-agents-in-parallel/4177
23. Hierarchical Process – CrewAI, geopend op mei 21, 2025, https://docs.crewai.com/how-to/hierarchical-process
24. Understanding AI Agent Orchestration – Botpress, geopend op mei 21, 2025, https://botpress.com/blog/ai-agent-orchestration
25. Comparing AI agent frameworks: CrewAI, LangGraph, and BeeAI – IBM Developer, geopend op mei 21, 2025, https://developer.ibm.com/articles/awb-comparing-ai-agent-frameworks-crewai-langgraph-and-beeai
26. Comparing AI agent frameworks: CrewAI, LangGraph, and BeeAI – IBM Developer, geopend op mei 21, 2025, https://developer.ibm.com/articles/awb-comparing-ai-agent-frameworks-crewai-langgraph-and-beeai/
27. Memory – CrewAI, geopend op mei 21, 2025, https://docs.crewai.com/concepts/memory
28. AutoGen | Phoenix – Arize AI, geopend op mei 21, 2025, https://docs.arize.com/phoenix/learn/agents/agent-workflow-patterns/autogen
29. Agents — AutoGen – Microsoft Open Source, geopend op mei 21, 2025, https://microsoft.github.io/autogen/stable/user-guide/agentchat-user-guide/tutorial/agents.html
30. How to Build an LLM Agent With AutoGen: Step-by-Step Guide, geopend op mei 21, 2025, https://neptune.ai/blog/building-llm-agents-with-autogen
31. Building Your First Hierarchical Multi-Agent System – Spheron’s Blog, geopend op mei 21, 2025, https://blog.spheron.network/building-your-first-hierarchical-multi-agent-system
32. Mixture of Agents — AutoGen – Microsoft Open Source, geopend op mei 21, 2025, https://microsoft.github.io/autogen/stable//user-guide/core-user-guide/design-patterns/mixture-of-agents.html
33. Conversation Patterns | AutoGen 0.2 – Microsoft Open Source, geopend op mei 21, 2025, https://microsoft.github.io/autogen/0.2/docs/tutorial/conversation-patterns/
34. Memory and RAG — AutoGen – Microsoft Open Source, geopend op mei 21, 2025, https://microsoft.github.io/autogen/stable//user-guide/agentchat-user-guide/memory.html
35. Memory — AutoGen – Microsoft Open Source, geopend op mei 21, 2025, https://microsoft.github.io/autogen/0.4.3/user-guide/agentchat-user-guide/memory.html
36. Memory and RAG — AutoGen – Microsoft Open Source, geopend op mei 21, 2025, https://microsoft.github.io/autogen/stable/user-guide/agentchat-user-guide/memory.html
37. Building Agentic AI Systems: Create intelligent, autonomous AI …, geopend op mei 21, 2025, https://dokumen.pub/building-agentic-ai-systems-create-intelligent-autonomous-ai-agents-that-can-reason-plan-and-adapt-9781803238753.html
38. arxiv.org, geopend op mei 21, 2025, https://arxiv.org/html/2505.10468v1
39. (PDF) Emergent Properties for Data Distribution in a Cognitive MAS, geopend op mei 21, 2025, https://www.researchgate.net/publication/220117727_Emergent_Properties_for_Data_Distribution_in_a_Cognitive_MAS
40. lia.disi.unibo.it, geopend op mei 21, 2025, https://lia.disi.unibo.it/~ao/pubs/pdf/2007/aamas.pdf
41. (PDF) Design Patterns for Multi-agent Systems: A Systematic …, geopend op mei 21, 2025, https://www.researchgate.net/publication/289338062_Design_Patterns_for_Multi-agent_Systems_A_Systematic_Literature_Review
42. The Soar Cognitive Architecture by John E Laird – Porchlight Book Company, geopend op mei 21, 2025, https://www.porchlightbooks.com/products/soar-cognitive-architecture-john-e-laird-9780262538534
43. Soar (cognitive architecture) – Wikipedia, geopend op mei 21, 2025, https://en.wikipedia.org/wiki/Soar_(cognitive_architecture)
44. ACT-R » About, geopend op mei 21, 2025, http://act-r.psy.cmu.edu/about/
45. ACT-R, geopend op mei 21, 2025, http://act-r.psy.cmu.edu/
46. Large Language Model-Enabled Multi-Agent Manufacturing Systems – arXiv, geopend op mei 21, 2025, https://arxiv.org/html/2406.01893v2
47. Large Language Model-Enabled Multi-Agent Manufacturing Systems – arXiv, geopend op mei 21, 2025, https://arxiv.org/pdf/2406.1893
48. Keynote Speakers – AAMAS 2025 Detroit, geopend op mei 21, 2025, https://aamas2025.org/index.php/conference/program/keynote-speakers/
49. 1st International Workshop (2025) on AI Agent Reasoning and Decision-Making, geopend op mei 21, 2025, https://ai-agent-reasoning.com/
50. arxiv.org, geopend op mei 21, 2025, https://arxiv.org/html/2503.13415v1
51. (PDF) A survey of multi-agent deep reinforcement learning with communication, geopend op mei 21, 2025, https://www.researchgate.net/publication/377208188_A_survey_of_multi-agent_deep_reinforcement_learning_with_communication
52. Practically Coordinating, geopend op mei 21, 2025, https://ojs.aaai.org/aimagazine/index.php/aimagazine/article/view/1443/1342
53. 3 Agent patterns are dominating agentic systems : r/AI_Agents – Reddit, geopend op mei 21, 2025, https://www.reddit.com/r/AI_Agents/comments/1jx9hvp/3_agent_patterns_are_dominating_agentic_systems/
54. Main Track Accepted Papers – IJCAI 2024, geopend op mei 21, 2025, https://ijcai24.org/main-track-accepted-papers/index.html
55. IJCAI-95 Workshop on Adaptation and Learning in Multiagent Systems – ResearchGate, geopend op mei 21, 2025, https://www.researchgate.net/publication/277055667_IJCAI-95_Workshop_on_Adaptation_and_Learning_in_Multiagent_Systems
56. A Survey of Scaling in Large Language Model Reasoning – arXiv, geopend op mei 21, 2025, https://arxiv.org/html/2504.02181v1
57. Cognitive Agent Architectures: Revolutionizing AI with … – SmythOS, geopend op mei 21, 2025, https://smythos.com/ai-agents/agent-architectures/cognitive-agent-architectures/
58. arxiv.org, geopend op mei 21, 2025, https://arxiv.org/html/2505.02024v1
59. Multi-Agent AI Systems: Orchestrating AI Workflows – V7 Labs, geopend op mei 21, 2025, https://www.v7labs.com/blog/multi-agent-ai
60. What are the challenges of designing multi-agent systems? – Milvus, geopend op mei 21, 2025, https://milvus.io/ai-quick-reference/what-are-the-challenges-of-designing-multiagent-systems
61. A Survey of AI Agent Protocols – arXiv, geopend op mei 21, 2025, https://arxiv.org/html/2504.16736v2
62. A Review of Multi-Agent Reinforcement Learning Algorithms – MDPI, geopend op mei 21, 2025, https://www.mdpi.com/2079-9292/14/4/820
63. AutoP2C: An LLM-Based Agent Framework for Code Repository Generation from Multimodal Content in Academic Papers – arXiv, geopend op mei 21, 2025, https://arxiv.org/html/2504.20115v1
64. Why Do Multi-Agent LLM Systems Fail? – arXiv, geopend op mei 21, 2025, https://arxiv.org/html/2503.13657v1
65. AWS | Community | Multi-Agent System Patterns in Financial …, geopend op mei 21, 2025, https://community.aws/content/2uDxjoo105xRO6Q7mfkogmOYTVp/multi-agent-system-patterns-in-financial-services-architectures-for-next-generation-ai-solutions
66. Multi-agent architectures are the FUTURE | ABN Software, geopend op mei 21, 2025, https://news.abnasia.org/en/blog/posts/en-multi-agent-architectures-are-the-future-3086
67. Aman’s AI Journal • Primers • Agents, geopend op mei 21, 2025, https://aman.ai/primers/ai/agents/
68. Agent Communication in Multi-Agent Systems … – SmythOS, geopend op mei 21, 2025, https://smythos.com/ai-agents/multi-agent-systems/agent-communication-in-multi-agent-systems/
69. Multi-agent system – Wikipedia, geopend op mei 21, 2025, https://en.wikipedia.org/wiki/Multi-agent_system
70. Can We Trust AI Agents? A Case Study of an LLM-Based Multi-Agent System for Ethical AI, geopend op mei 21, 2025, https://arxiv.org/html/2411.08881v2
71. (PDF) A multi-agent approach with verifiable and data-sovereign information flows for decentralizing redispatch in distributed energy systems – ResearchGate, geopend op mei 21, 2025, https://www.researchgate.net/publication/389277744_A_multi-agent_approach_with_verifiable_and_data-sovereign_information_flows_for_decentralizing_redispatch_in_distributed_energy_systems
72. Systems Thinking for Sustainable Crime Prevention; Planning for Risky Places – DiVA portal, geopend op mei 21, 2025, https://www.diva-portal.org/smash/get/diva2:1910030/FULLTEXT01.pdf
73. (PDF) A review of the recent contribution of systems thinking to operational research, geopend op mei 21, 2025, https://www.researchgate.net/publication/227414901_A_review_of_the_recent_contribution_of_systems_thinking_to_operational_research
74. Harnessing Multi-Agent LLMs for Complex Engineering Problem-Solving: A Framework for Senior Design Projects – arXiv, geopend op mei 21, 2025, https://arxiv.org/html/2501.01205
75. From Autonomous Agents to Integrated Systems, A New Paradigm: Orchestrated Distributed Intelligence – arXiv, geopend op mei 21, 2025, https://arxiv.org/html/2503.13754v2
76. arxiv.org, geopend op mei 21, 2025, https://arxiv.org/html/2503.00248v1
77. Human-In-the-Loop Software Development Agents – arXiv, geopend op mei 21, 2025, https://arxiv.org/html/2411.12924v2
78. TAMA: A Human-AI Collaborative Thematic Analysis Framework …, geopend op mei 21, 2025, https://www.researchgate.net/publication/390212510_TAMA_A_Human-AI_Collaborative_Thematic_Analysis_Framework_Using_Multi-Agent_LLMs_for_Clinical_Interviews/fulltext/67e4c26af966c17052a73660/TAMA-A-Human-AI-Collaborative-Thematic-Analysis-Framework-Using-Multi-Agent-LLMs-for-Clinical-Interviews.pdf
79. Automatic Control With Human-Like Reasoning – TU Delft Repository, geopend op mei 21, 2025, https://repository.tudelft.nl/file/File_cce81e83-df06-4c16-90b8-b015381d7ee4
80. TrialGenie: Empowering Clinical Trial Design with Agentic …, geopend op mei 21, 2025, https://www.medrxiv.org/content/10.1101/2025.04.17.25326033v1.full-text
81. arxiv.org, geopend op mei 21, 2025, https://arxiv.org/pdf/2504.06269
82. (PDF) From Mind to Machine: The Rise of Manus AI as a Fully Autonomous Digital Agent, geopend op mei 21, 2025, https://www.researchgate.net/publication/391461097_From_Mind_to_Machine_The_Rise_of_Manus_AI_as_a_Fully_Autonomous_Digital_Agent/download
83. arxiv.org, geopend op mei 21, 2025, https://arxiv.org/html/2505.00675v1
84. MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents – arXiv, geopend op mei 21, 2025, https://arxiv.org/html/2503.01935v1
85. Why Do Multi-Agent LLM Systems Fail? – arXiv, geopend op mei 21, 2025, https://arxiv.org/pdf/2503.13657
86. arxiv.org, geopend op mei 21, 2025, https://arxiv.org/pdf/2503.13275
87. HM-RAG: Hierarchical Multi-Agent Multimodal Retrieval Augmented Generation – arXiv, geopend op mei 21, 2025, https://arxiv.org/html/2504.12330v1
88. Dynamic Knowledge Integration in Multi-Agent Systems for Content Inference | OpenReview, geopend op mei 21, 2025, https://openreview.net/forum?id=5XNYu4rBe4
89. (PDF) A Long Way to Quality-Driven Pattern-Based Architecting, geopend op mei 21, 2025, https://www.researchgate.net/publication/309638977_A_Long_Way_to_Quality-Driven_Pattern-Based_Architecting
90. Advancing Multi-Agent Systems Through Model Context Protocol: Architecture, Implementation, and Applications – ResearchGate, geopend op mei 21, 2025, https://www.researchgate.net/publication/391329081_Advancing_Multi-Agent_Systems_Through_Model_Context_Protocol_Architecture_Implementation_and_Applications
91. (PDF) Latest Advances in Agentic AI Architectures, Frameworks, Technical Capabilities, and Applications – ResearchGate, geopend op mei 21, 2025, https://www.researchgate.net/publication/389505727_Latest_Advances_in_Agentic_AI_Architectures_Frameworks_Technical_Capabilities_and_Applications
92. Knowledge-Based Multi-Agent Framework for Automated Software Architecture Design, geopend op mei 21, 2025, https://arxiv.org/html/2503.20536
93. An Agent-Based System for Automated Configuration and Coordination of Robotic Operations in Real Time—A Case Study on a Car Floor Welding Process – MDPI, geopend op mei 21, 2025, https://www.mdpi.com/2504-4494/4/3/95
94. Chebyshev Center Computation on Probability Simplex with $\alpha$-divergence Measure | Code Ocean, geopend op mei 21, 2025, https://codeocean.com/explore/500430ed-ca70-46ea-903a-4b251539f64e?query=IEEE%20Photonics%20Technology%20Letters&page=1&filter=all&refine=journal
95. (PDF) Analyze traffic forecast for decentralized multi agent system using I-ACO routing algorithm – ResearchGate, geopend op mei 21, 2025, https://www.researchgate.net/publication/378803401_Analyze_traffic_forecast_for_decentralized_multi_agent_system_using_I-ACO_routing_algorithm
96. Optimizing Package Delivery with Quantum Annealers: Addressing Time-Windows and Simultaneous Pickup and Delivery This work was supported by the Basque Government through Plan complementario comunicación cuántica (EXP. 2022/01341) (A/20220551) and HAZITEK program (QUANTHIB project, ZL-2024/00334). During the preparation of this work the authors – arXiv, geopend op mei 21, 2025, https://arxiv.org/html/2504.01560
97. www.arxiv.org, geopend op mei 21, 2025, https://www.arxiv.org/pdf/2505.02861
98. (PDF) Neural Orchestration for Multi-Agent Systems: A Deep Learning Framework for Optimal Agent Selection in Multi-Domain Task Environments – ResearchGate, geopend op mei 21, 2025, https://www.researchgate.net/publication/391491574_Neural_Orchestration_for_Multi-Agent_Systems_A_Deep_Learning_Framework_for_Optimal_Agent_Selection_in_Multi-Domain_Task_Environments
99. publications.ics.forth.gr, geopend op mei 21, 2025, http://publications.ics.forth.gr/_publications/Hatzivasilis_Master_Thesis.pdf
100. (PDF) ETHICAL WORKFORCE PLANNING AT SCALE: DESIGNING …, geopend op mei 21, 2025, https://www.researchgate.net/publication/391217380_ETHICAL_WORKFORCE_PLANNING_AT_SCALE_DESIGNING_AI_PREDICTIVE_SYSTEMS_WITH_GOVERNANCE_FOR_MULTI-AGENT_COLLABORATION
101. (PDF) Multi-Agent Security Tax: Trading Off Security and Collaboration Capabilities in Multi-Agent Systems – ResearchGate, geopend op mei 21, 2025, https://www.researchgate.net/publication/389392176_Multi-Agent_Security_Tax_Trading_Off_Security_and_Collaboration_Capabilities_in_Multi-Agent_Systems