Beyond LLMs architecture the path to AGI.

by Djimit

1. Introduction: The Imperative for New AGI Architectures

The aspiration to create Artificial General Intelligence (AGI)—AI systems possessing versatile, human-like cognitive abilities capable of learning and adapting across a wide spectrum of tasks—has been a long-standing ambition within the scientific community.¹ Such systems promise transformative benefits, from raising living standards globally to deepening human knowledge and accelerating scientific discovery.³ Recent years have witnessed remarkable advancements, predominantly driven by the scaling of deep learning models, with Large Language Models (LLMs) at the forefront.¹ However, a critical assessment reveals that while LLMs are powerful tools, their current trajectory may be insufficient for achieving true AGI.

Critical Assessment of LLMs as a Sole Path to AGI

LLMs, despite their impressive capabilities in generating coherent text and engaging in seemingly intelligent dialogue, exhibit fundamental shortcomings when considered as a direct path to AGI. Their core architecture, typically based on transformers, trains them to be next-token predictors, operating primarily on statistical patterns learned from vast textual corpora.⁹ This operational mode means they lack genuine grounding in real-world understanding; they can manipulate symbols effectively but without a deeper comprehension of their meaning. Common criticisms, such as struggles with mathematical reasoning, inconsistent grammatical accuracy, and a propensity to fabricate information (often termed “hallucination”), are well-founded.⁹

The perceived progress of LLMs, often demonstrated by year-over-year improvements on various benchmarks, can be misleading. Such improvements are frequently attributable to the models encountering test problems, or data highly similar to them, during their extensive training phases.⁹ True generalization to entirely novel scenarios, a hallmark of AGI, remains an elusive challenge. The notion that AGI can be achieved by simply “brute-forcing” with ever-larger parameter counts and datasets is increasingly viewed as “magical thinking”.⁹

The distinction between System 1 (fast, intuitive thinking) and System 2 (slow, deliberate reasoning), as conceptualized by Kahneman, is pertinent here. While some speculate that LLMs might emulate System 1 capabilities, attempts to elicit robust System 2 thinking through techniques like Chain of Thought (CoT) prompting have shown limitations in practical, real-world applications.⁹ Neuro-symbolic AI approaches, in contrast, explicitly aim to integrate neural pattern recognition (akin to System 1) with symbolic, rule-based reasoning (akin to System 2).¹⁰

Furthermore, the data-intensive nature of LLMs and their predominantly static training regimes pose significant hurdles. These models require colossal datasets for pre-training and are not inherently designed for efficient real-time learning or continuous adaptation from ongoing experience.¹³ While techniques like Retrieval-Augmented Generation (RAG) and certain forms of online learning represent incremental steps, they fall short of the seamless, continuous learning and knowledge integration characteristic of human intelligence.¹³ The challenge is amplified when considering AGI deployment on resource-constrained edge devices, where continuous learning and personalization are paramount.¹ The lack of inherent embodiment, symbol grounding, and a deep understanding of causality and memory further distances current LLMs from the multifaceted intelligence required for AGI.⁵

These limitations suggest an “LLM ceiling” for AGI. The architectural core of LLMs—next-token prediction—while powerful for certain tasks, imposes a fundamental constraint on achieving the adaptive, reasoning-heavy, and deeply understanding nature of AGI. The path to AGI appears to require more than statistical pattern matching; it necessitates architectures designed for higher-order cognitive functions. Moreover, the “data-reality gap” is a significant concern. LLMs learn from static, albeit vast, datasets, whereas human intelligence develops through continuous, real-time, multimodal interaction with the environment.¹³ This interaction provides crucial grounding for concepts and an understanding of cause-and-effect, elements largely missing from LLM training paradigms, leading to knowledge that can be unmoored from tangible experience.⁵ There is a growing consensus that AGI will not emerge from a single monolithic architecture but will necessitate hybrid systems integrating diverse capabilities.¹

Thesis: Proposing Recursive-Diffusive-Coherent (RDC) Architectures as a More Holistic and Potentially Viable Direction

The argument that achieving true AGI demands fundamentally new architectures, rather than merely scaling existing models, is gaining traction.¹ This report posits that a more holistic and potentially viable direction lies in the investigation of Recursive-Diffusive-Coherent (RDC) architectures. This conceptual framework proposes the synergistic integration of three core functional pillars:

• Recursive mechanisms enabling self-improvement, meta-learning, and AI metacognition.
• Diffusive capabilities leveraging advanced generative models, particularly diffusion models, extended beyond perception to encompass conceptual domains, planning, reasoning, and creative problem-solving from unstructured states.
• Coherent frameworks ensuring the integrated and harmonious operation of diverse AI subsystems, achieving unified understanding and action through shared representations, neuro-symbolic integration, and brain-inspired principles such as homeostatic regulation and thalamocortical synchronization.

The RDC paradigm offers a structured approach to designing AGI systems that can learn, adapt, reason, and create in a more integrated and robust manner than current LLM-centric approaches. The following table summarizes key AGI capabilities, corresponding LLM deficiencies, and how RDC architectural components might offer solutions.

Table 1: LLM Limitations for AGI and Potential RDC Solutions

This table underscores the rationale for exploring RDC architectures. By systematically addressing the multifaceted requirements of AGI and the identified shortcomings of LLMs, the RDC framework provides a conceptual roadmap for the development of more capable and potentially AGI-level systems. The subsequent sections will delve into each component of the RDC architecture, exploring their theoretical underpinnings, current technological advancements, and their potential synergistic contributions to the AGI quest.

2. The Recursive Engine: Architecting Self-Improvement and Meta-Cognition

A pivotal component of the proposed RDC architecture is the “Recursive Engine,” designed to endow AGI systems with the capacity for continuous self-improvement and sophisticated meta-cognitive abilities. This moves beyond simple parameter updates within a fixed architecture, envisioning systems that can fundamentally enhance their own intelligence and operational strategies over time.

Foundations of Recursive Self-Improvement (RSI) in AI Systems

Recursive Self-Improvement (RSI) is defined as a process wherein an AI system augments its own capabilities and intelligence autonomously, without direct human intervention, potentially leading to a rapid increase in intelligence, sometimes termed an “intelligence explosion” or superintelligence.¹⁶ The core idea is not just self-improvement, but improving the ability to make self-improvements.¹⁹ If an AI can enhance its own improvement mechanisms, each cycle could yield exponentially greater gains.¹⁹

The concept of “Seed AI” refers to initial AI systems specifically architected for RSI.¹⁹ A hypothetical “seed improver” architecture might involve an LLM equipped with advanced capabilities such as planning, reading, writing, compiling, testing, and executing arbitrary code. This would be coupled with a recursive self-prompting loop, a goal-oriented design (e.g., the initial goal to “self-improve your capabilities”), and robust validation and testing protocols to ensure that self-modifications do not lead to a degradation of abilities or derail the system from its objectives.¹⁸

Practical examples of RSI principles are emerging. The LADDER framework enables LLMs to autonomously enhance their problem-solving skills by recursively generating and solving progressively simpler variants of complex problems, demonstrating self-directed strategic learning.²⁰ Similarly, the WebEvolver framework co-trains a world model with an agent, using trajectory data sampled autonomously by the agent to improve both the agent’s policy and the world model in a recursive loop.²¹ The DREAMCoder system, through its wake-sleep algorithm, iteratively extends its domain-specific language (symbolic abstractions) and trains its neural recognition model, showcasing recursive library learning and neural network refinement.²³

Key Enablers for RSI

Several technological advancements are crucial for realizing effective RSI:

Differentiable Programming (∂P): This paradigm allows for the encoding of problem structure directly into models, shifting from heavily parameterized “black-box” models to simpler ones that explicitly leverage domain knowledge.²⁴ Critically, ∂P enables gradient-based optimization of complex programs that include control flow structures like loops, branches, and recursion, by ensuring that all programmatic constructs are differentiable.²⁴ Modern libraries such as PyTorch facilitate this by allowing almost arbitrary code to be differentiated.²⁵ For AI self-improvement, this is transformative: an AI could potentially learn to refine its own algorithms if those algorithms are represented as differentiable programs, with the improvement process itself framed as an optimization problem solvable via gradient descent.²⁵ This suggests ∂P could serve as a foundational substrate for learned self-modification across diverse aspects of an AI’s software, from parameters to control logic.

Neuro-Symbolic Rewriting: Neuro-symbolic AI integrates the pattern-recognition strengths of neural networks with the rule-based reasoning capabilities of symbolic AI.¹⁰ Certain integration methods, such as “Neural: Symbolic → Neural” (where symbolic reasoning generates or labels training data for neural networks) or “Neural_Symbolic_” (where neural networks are generated from symbolic rules), inherently involve rewriting or transformation capabilities.¹⁰ This could empower an AI to rewrite its own symbolic knowledge base or even modify parts of its neural architecture based on experience and logical inference, representing a form of structural self-improvement. The development of heterogeneous representation spaces in multi-modal neuro-symbolic AI, which can natively support both neural embeddings and symbolic logic, further facilitates this integrated learning and reasoning, allowing for more seamless self-modification.²⁶

Meta-Learning (“Learning to Learn”): AI meta-learning focuses on improving the learning process itself, enhancing strategizing capabilities, and enabling better control over cognitive functions, drawing analogies to human metacognition.²⁸ It involves training models to become more adept at learning, allowing them to adapt more rapidly to new tasks or domains.¹⁶ A specific technique, Meta Prompting, emphasizes the structure and syntax of information to decompose complex problems. This allows an LLM to function as a “conductor,” managing and integrating multiple independent LM queries or “expert” instances of itself, thereby achieving a meta-level control over the problem-solving process.³⁰ This is akin to a recursive decomposition and delegation strategy.

The Role of AI Metacognition and Awareness in Guiding Recursive Processes

For RSI to be effective and safe, it must be guided. AI awareness, defined as a system’s functional ability to represent and reason about its own identity, capabilities, and informational states, is paramount.³² Several forms of awareness are relevant:

• Meta-cognition: The AI’s capacity to represent and reason about its own internal states and cognitive processes (e.g., assessing its knowledge boundaries, evaluating the confidence of its answers, self-reflecting, and adjusting reasoning strategies). Current top-tier LLMs exhibit nascent metacognitive abilities, such as identifying required reasoning skills for a task and improving performance through self-reflection and iterative revision of answers.³³ This is crucial for self-correction and autonomous planning within an RSI loop.
• Self-awareness: The AI’s recognition of its own identity, knowledge, and limitations. LLMs often self-identify as AI assistants and can demonstrate an awareness of their knowledge boundaries.³³
• Social Awareness: The ability to model the knowledge, intentions, and behaviors of other agents. Some LLMs show rudimentary Theory of Mind-like capabilities.³³
• Situational and Contextual Awareness: Understanding the operational context and adapting behavior accordingly. LLMs can, for example, reject user requests that violate safety criteria or infer context from abstract rules.³³

The link to RSI is clear: AI systems possessing higher levels of awareness, particularly metacognition, tend to exhibit more intelligent behaviors.³² Metacognition is vital for an RSI system to monitor its own improvements, detect errors or misalignments, and guide its evolutionary trajectory in a beneficial direction. Self-awareness of limitations can prevent the system from making flawed modifications or overreaching its capabilities. This points towards a “competence-awareness loop” in RSI: effective self-modification requires a sophisticated understanding of what to change and why, implying a tight feedback between recursive capabilities and AI metacognition. Uninformed modifications can lead to performance degradation or unsafe behavior.¹⁶ Therefore, an AI with enhanced metacognitive awareness can make more informed decisions about its self-modifications, leading to more effective and safer RSI. This, in turn, can create a positive feedback cycle where better awareness fosters better self-improvement, which can then further enhance the mechanisms for awareness itself.

RSI is not a monolithic concept; it can manifest in various forms, including parameter optimization, architectural refinement (via neuro-symbolic rewriting or ∂P for structural changes), strategic improvement (as seen in LADDER or Meta Prompting), or knowledge base expansion (like in DREAMCoder). A mature RDC-AGI might synergistically employ multiple forms of recursion, guided by increasingly sophisticated metacognitive oversight. Advances in meta-learning and AI awareness are thus critical prerequisites for developing robust and safe RSI, without which RSI risks becoming an unguided and potentially perilous process.

3. The Diffusive Fabric: Generative Power for Conceptual Reasoning and Novelty

The “Diffusive Fabric” of the RDC architecture refers to the integration of advanced generative capabilities, primarily inspired by diffusion models, but extended beyond mere perceptual generation into the realms of conceptual reasoning, planning, and novel problem-solving. This component is envisioned as an engine for exploration and structured creation.

Expanding Diffusion Models Beyond Perceptual Generation

Diffusion models have achieved remarkable success in generating high-fidelity images and videos, with systems like DALL-E, Midjourney, Stable Diffusion, and Sora capturing public and scientific attention.³⁶ These models typically operate through a dual-phase mechanism: a forward process that incrementally adds noise to data until it becomes an unstructured signal, and a learned reverse process that iteratively removes this noise to reconstruct or generate new data samples.³⁶

Significantly, the application of diffusion models is rapidly expanding beyond visual and auditory domains. There is a notable growth in their use for planning tasks, including robot motion planning, offline reinforcement learning, hierarchical planning, and trajectory optimization in autonomous driving.³⁸ Their inherent ability to explore vast solution spaces and generate diverse, high-quality outputs makes them well-suited for high-dimensional decision-making problems. The fundamental principle of capturing complex data distributions and iteratively refining noisy inputs into coherent outputs is being leveraged for tasks in abstract conceptual domains, demonstrating their versatility.³⁸

The “Noise-to-Structure” Paradigm: Fostering Creative Problem-Solving

The core operational principle of diffusion models—adding random noise and then learning to reverse this process to generate structure—resonates deeply with concepts of creative problem-solving.³⁷ There are intriguing parallels with human cognition; for instance, it has been hypothesized that inherent noise within the brain’s neural processes might enable extraordinary leaps of imagination and creativity.³⁹ Indeed, AI image generation systems often explicitly use random noise in their training processes and as initial seeds for generating new images.³⁹ Similarly, LLMs employ a “temperature” parameter to inject a controlled amount of randomness (noise) into their token selection process, leading to more varied and sometimes more creative outputs.³⁹

Diffusion models, by commencing from an unstructured noise state and progressively generating structured output, can effectively explore vast solution landscapes and discover novel configurations or solutions that may not have been explicitly present in their training data.³⁹ This “noise-to-structure” capability is a powerful mechanism for fostering novelty.

This paradigm can be further enhanced by structured problem-solving methodologies like TRIZ (Theory of Inventive Problem Solving). TRIZ offers a systematic approach by identifying common patterns in problems and solutions, along with a set of “inventive principles” derived from analyzing a vast database of innovations.⁴⁰ An AI system could leverage TRIZ to provide high-level guidance or constraints to the diffusive generation process. Faced with an unstructured, “noise-like” problem space, the AI could use TRIZ principles to identify underlying contradictions or to select promising inventive principles (e.g., segmentation, dynamization) to steer the diffusive exploration towards more targeted and potentially more innovative solutions.⁴⁰ This synergy could make the creative problem-solving process more efficient and effective.

Latent Diffusion Models: Semantic Understanding and Simulative Capabilities

A significant advancement in diffusion modeling is the development of Latent Diffusion Models (LDMs), which often employ transformers as a core component, leading to Diffusion Transformers (DiTs).³⁶ DiTs have shown superior performance compared to traditional U-Net (CNN-based) backbones in diffusion models, particularly when dealing with large datasets and complex image generation tasks. They typically operate on latent “patches” of images, processing image data in a compressed latent space rather than directly in pixel space.³⁶

These models demonstrate a degree of semantic understanding by allowing the generation process to be conditioned on various inputs, such as descriptive text embeddings or class labels.³⁶ The transformer architecture, with its attention mechanisms, facilitates the integration of this conditioning information, guiding the diffusion process to produce outputs that align with the given semantic concepts.

The use of latent spaces is a key strategy in modern generative models. Typically, an autoencoder is first trained to map high-dimensional input signals (like images or sounds) to a lower-dimensional, compact latent representation. Subsequently, a generative model—either autoregressive or a diffusion model—is trained to operate directly on these latent representations.⁴² This approach allows the model to focus on capturing and manipulating perceptually meaningful information, abstracting away from irrelevant low-level noise or detail. The characteristics of this latent space—its capacity, shaping (how information is represented), and curation (what information is preserved)—significantly impact the “modelability” of the information and the quality of the generated outputs.⁴²

Beyond generation, these generative models, particularly when operating in semantically rich latent spaces, can exhibit simulative capabilities. For instance, the WebEvolver framework employs a co-evolving World Model (an LLM) that learns to predict subsequent web page states based on current states and agent actions. This World Model effectively simulates web interactions, generating synthetic trajectories that are then used to train the agent’s policy.²¹ This demonstrates how generative models can function as dynamic simulators for complex environments, providing valuable data for learning and planning. Furthermore, the idea of AI models “thinking” in latent space—iterating on their internal latent representations before producing an output token or action—is gaining traction. This could allow for more complex internal reasoning processes that are decoupled from the immediate observable context, potentially mimicking human thought more closely.⁴³

The core mechanism of diffusion—iterative refinement from a noisy or unstructured state under the guidance of learned priors and conditioning information—is emerging as a powerful paradigm for exploration and generation, not just in perceptual domains but also in abstract, conceptual spaces such as plans, logical structures, or problem solutions. The “noise” can represent an unformed plan, an incomplete argument, or an abstract problem state, and the “denoising” process, guided by learned knowledge and current goals, can iteratively refine this into a coherent and structured output. This makes diffusion a general mechanism for generative exploration and construction in non-perceptual domains, which is critical for AGI-level reasoning and problem-solving.

The success of latent diffusion models ⁴¹ indicates that operating within a compressed, semantically rich latent space is crucial for making diffusion principles computationally tractable and effective for complex generation tasks, including conceptual ones. By learning compact latent representations that capture essential semantic information ⁴², the diffusion process can operate more efficiently in this lower-dimensional, structured space, focusing on high-level semantic consistency. For an RDC-AGI, this implies that diffusive components might operate on shared latent representations of problems, goals, and world states, facilitating seamless integration with the recursive and coherent modules of the architecture. The “diffusive” component of an RDC-AGI, therefore, is not merely about data generation; it represents a fundamental process of structured creation from a less structured state, applicable to ideas, plans, and solutions, forming a core aspect of creative and adaptive intelligence.

4. The Coherent Framework: Weaving Together Diverse Intelligences

Achieving AGI will almost certainly involve the integration of multiple specialized AI subsystems, each potentially excelling in different modalities or cognitive functions.¹ The “Coherent Framework” of the RDC architecture addresses the profound challenge of ensuring these diverse components work together harmoniously, share information effectively, and contribute to unified goals and a consistent understanding of the world. The NGENT proposal, for example, explicitly argues for synthesizing strengths from specialized agents (text, vision, robotics, RL) into a unified framework to achieve the versatility characteristic of human intelligence.²

Strategies for Integration

Several strategies are key to building such a coherent framework:

Shared Latent Spaces and Common Grounding:
Latent representations, learned by neural networks, offer a way to capture perceptually and semantically meaningful information in a compact form.42 Training different generative or reasoning models on latent variables extracted by a common encoder can enable these diverse models to operate on a shared, underlying understanding of the input data.42 The idea of allowing models to perform computations or “think” within these latent spaces before generating an output token or action is gaining traction, as it could provide a common representational substrate for reasoning across different AI modules, such as LLMs, planners, and visual reasoners.43 However, maintaining the consistency and alignment of these shared latent spaces, especially when dealing with non-identically distributed data from various sources or evolving agent components, presents a significant challenge. Research in areas like federated learning, exemplified by FissionVAE which proposes decoupling latent spaces and tailoring decoders for different client groups, highlights the complexity of creating and maintaining robust shared representations.47 This implies that dynamic alignment and recalibration mechanisms for these shared spaces will be crucial for long-term coherence.

Neuro-Symbolic AI as a Bridge:
Neuro-symbolic AI architectures are inherently designed to foster coherence by combining the pattern recognition strengths of neural networks (often associated with System 1 or intuitive thinking) with the explicit, rule-based reasoning capabilities of symbolic AI (associated with System 2 or deliberate thinking).10 Henry Kautz’s taxonomy outlines various methods for this integration, such as symbolic systems invoking neural modules (Symbolic[Neural], e.g., AlphaGo) or neural models calling symbolic reasoning engines (Neural, e.g., ChatGPT querying WolframAlpha).10 This fusion is considered crucial for AGI as it enables systems to reason with structured knowledge, learn abstract concepts more effectively, and build more comprehensive cognitive models.10 The development of heterogeneous representation spaces within neuro-symbolic AI, which can natively accommodate both neural embeddings and symbolic logic, allows for direct interaction and reasoning between these paradigms without lossy intermediate translations.26 Furthermore, neuro-symbolic approaches can significantly enhance explainability and trustworthiness, as the symbolic components can provide transparent reasoning pathways for the system’s decisions—qualities vital for coherent and safe AGI.11

Biomimetic Inspiration for Coherence:
The human brain exhibits remarkable coherence despite its vast complexity, offering inspiration for AI architectures.

Thalamocortical Synchronization: Synchronized neural oscillations, particularly in the 7–14 Hz range, between the thalamus and cerebral cortex are believed to play a key role in integrated information processing, consciousness, and attentional states.⁴⁸ Different neural firing modes (e.g., burst mode prevalent in sleep versus tonic mode in alertness) are associated with distinct global brain states and can be modulated by complex external stimuli.⁴⁸ AI models inspired by the thalamocortical-basal ganglia system are being developed to simulate conscious brain states and their disorders, suggesting pathways for implementing dynamic state control and information integration mechanisms in AI.⁴⁹

Homeostatic Regulation: Biological organisms operate under the principle of homeostasis, striving to maintain numerous internal physiological and psychological variables within acceptable, “good enough” ranges, rather than pursuing unbounded maximization of any single variable.¹⁷ This results in a multi-objective, bounded control system that naturally balances competing needs. Applied to AI, a homeostatic architecture would involve defining target ranges for various objectives; the AI would then dynamically allocate resources and adapt its behavior to keep all critical variables within their desired zones, operating in a balanced state.¹⁷ This approach inherently leads to bounded, “task-based” behavior—if all needs are satisfied, the agent is content and does not relentlessly seek further optimization. This also fosters natural corrigibility, as the system is designed to adapt to changing setpoints or new goals.¹⁷ Neural networks incorporating homeostatic principles, where the system’s performance directly influences its learning capability, have demonstrated improved adaptability when faced with changing data patterns and concept shifts.⁵⁰

Architectural Considerations from Generalist Agents and Consciousness Models

Insights from existing generalist agent architectures and theoretical models of consciousness also inform the design of coherent AGI:

DeepMind’s Gato: This agent utilizes a single, large transformer sequence model (1.2 billion parameters) to perform over 600 distinct tasks across diverse modalities (text, images, proprioception, actions).⁵¹ Coherence is achieved by serializing all input data and actions into a flat sequence of tokens, which are processed by the same set of model weights. Gato decides what to output (text, joint torques, etc.) based on the context of the token sequence, demonstrating how a unified model and representation can handle a wide array of functions.⁵²

NGENT Proposal: This proposal argues for the integration of specialized AI agents (proficient in text, vision, robotics, RL, etc.) into a unified framework to achieve AGI.² It leverages the observed convergence in Transformer-based architectures across domains and advancements in learning algorithms like multi-task learning, transfer learning, and meta-learning to enable this synthesis.

Conscious Turing Machine (CTM): Inspired by Bernard Baars’ Global Workspace Theory, the CTM is a formal model proposing a “stage” (Short-Term Memory) that globally broadcasts information to an “audience” of numerous parallel processors (Long-Term Memory).⁵⁵ These processors compete to have their information featured on the stage. This architecture provides a mechanism for global information sharing, attentional focus, and a degree of integrated information processing (aligning with Integrated Information Theory), contributing to system-wide coherence without a centralized executive controller.⁵⁵

Neuroscience-Inspired Continuous Learning Systems: Recent proposals outline architectures for personalized AGI on edge devices that integrate complementary memory systems (for fast and slow learning), synaptic pruning, Hebbian plasticity, and sparse coding.¹ These brain-inspired mechanisms are inherently aimed at achieving coherent learning, memory consolidation, and efficient resource management over an AI’s lifetime.

True coherence in a complex, multi-component AGI might not arise from a rigid, top-down centralized controller, which can be a bottleneck and a single point of failure. Instead, coherence could be an emergent property stemming from well-designed interaction protocols between modules, shared representational frameworks (such as robust latent spaces or neuro-symbolic knowledge graphs), and self-organizing principles like homeostasis or the competitive dynamics envisioned in the CTM.¹⁰ This suggests a shift towards “emergent orchestration.”

For robust coherence and genuine understanding, a “symbol grounding triad” may be necessary: connecting the internal latent representations learned by neural networks to formal symbolic reasoning structures, with both being grounded in embodied interaction with the world (or a sufficiently rich simulated environment).⁵ Neuro-symbolic systems aim to bridge the neural and symbolic layers, and shared latent spaces can serve as a crucial interface. An AGI that successfully integrates these three aspects—flexible pattern recognition via latent spaces, structured reasoning via symbolic logic, and grounding via embodied experience—would likely achieve a far more coherent and robust understanding of its environment and tasks. Finally, the physical layer of coherence, enabled by heterogeneous computing architectures (CPUs, GPUs, NPUs) with optimized cache and memory hierarchies, is essential for the practical and efficient deployment of such complex RDC-AGI systems, especially on edge devices.⁵⁸

5. Synthesizing RDC Architectures: Towards a Blueprint for AGI

The individual pillars of Recursive self-improvement, Diffusive generative power, and Coherent integration, while powerful in their own right, promise their greatest potential for AGI when synergistically combined. This section explores how these elements might interplay to form a cohesive AGI architecture, discusses potential emergent properties, and addresses key architectural challenges.

Conceptualizing the Interplay: How RDC Elements Synergize

The RDC framework envisions a dynamic interplay where each component supports and enhances the others:

The Recursive Engine Drives Evolution: The recursive component, encompassing RSI mechanisms, meta-learning, and AI metacognition, functions as the system’s evolutionary engine. It is responsible for the continuous refinement and improvement of not only its own processes but also the diffusive (generative) models and the coherent (integrative) framework. For instance, the recursive engine could optimize the structure of latent spaces utilized by diffusion models for conceptual generation, fine-tune the rules within a neuro-symbolic reasoning module based on performance feedback, or even adjust the parameters of homeostatic regulation for better system stability. This ongoing self-modification ensures the AGI adapts and becomes more effective over time.

The Diffusive Fabric Provides Knowledge and Exploration: The diffusive component, leveraging advanced generative models, is the source of novelty, exploration, and structured creation. It can generate novel solutions to complex problems, formulate plans and hypotheses, and construct new conceptual structures. In a practical RDC system, diffusive models could create vast amounts of synthetic data for training other components (as seen in WebEvolver’s use of a generative world model ²¹), explore potential future states for long-horizon planning, or generate creative solutions to problems identified or decomposed by the recursive engine.

The Coherent Framework Ensures Unified Operation: The coherent component is the integrative backbone that weaves together the outputs of the diffusive processes and the modifications enacted by the recursive engine into a consistent and functional whole. Mechanisms like shared latent spaces, neuro-symbolic reasoning architectures, biomimetic principles like thalamocortical synchronization analogs, and homeostatic regulation ensure that the diverse parts of the AGI operate in concert, maintain a stable internal state, and work towards common, aligned goals. It grounds the system’s knowledge and actions.

This synergy can be illustrated through example AGI functions:

Advanced Problem Solving:

1. The Coherent System (e.g., through its integrated perceptual and reasoning modules) identifies and represents a complex, novel problem.
2. The Recursive Engine (perhaps employing meta-prompting-like strategies ³⁰) decomposes the complex problem into more manageable sub-problems.
3. Specialized Diffusive Modules are tasked with generating potential solution components for these sub-problems or exploring their respective solution spaces (potentially guided by TRIZ-like inventive principles applied to a “noise-to-structure” generation process ⁴⁰).
4. The Coherent System (e.g., using its neuro-symbolic reasoning capabilities) evaluates, filters, and integrates these generated components into a candidate overall solution.
5. The Recursive Engine (via its metacognitive functions) assesses the quality, feasibility, and potential consequences of the proposed solution. If the solution is deemed suboptimal or risky, it can trigger further iterations of diffusive exploration for alternative components or recursive refinement of its own problem-decomposition strategy or the evaluation criteria.

Continuous Learning and Adaptation in a Dynamic Environment:

1. The Coherent System, particularly if embodied, interacts with a dynamic and unpredictable external world, gathering sensory data.
2. A Diffusive Module, functioning as a generative world model, attempts to predict the outcomes of the agent’s actions and identifies surprising events or discrepancies between its predictions and actual observations (prediction errors).
3. The Recursive Engine utilizes these prediction errors as learning signals to update both the generative world model (to improve its predictive accuracy) and the agent’s internal policies or behavioral strategies (similar to the self-improvement loop in WebEvolver ²¹, or drawing from neuroscience-inspired continuous learning mechanisms ¹). This update process might involve differentiable programming to adjust the agent’s internal algorithms or decision-making structures.
4. The Coherent System, through mechanisms like homeostatic regulation ¹⁷, ensures that these adaptations maintain overall system stability, goal alignment, and resource balance.

Potential Emergent Properties of Integrated RDC Systems

The deep integration of recursive, diffusive, and coherent functionalities could lead to emergent properties that are more than the sum of their parts and are characteristic of advanced intelligence:

• True Continuous Lifelong Learning and Adaptation: Moving beyond static, offline training paradigms, an RDC-AGI could learn from every interaction and experience, continuously updating its knowledge, skills, and internal models in real-time, much like biological organisms.¹
• Robust Generalization to Novelty: The combination of explicit symbolic reasoning and knowledge representation (Coherent), diverse generative exploration of possibilities (Diffusive), and adaptive learning strategies that refine both knowledge and process (Recursive) could lead to significantly improved generalization to truly novel situations and unforeseen challenges.
• Autonomous Discovery and Innovation: The dynamic interplay between recursive self-improvement (which can refine search strategies and evaluation functions) and diffusive conceptual generation (which can propose novel ideas or structures) could enable the AGI to autonomously discover new scientific knowledge, invent novel technologies, or create original artistic works not directly conceived by its human designers.
• Emergent Goal-Awareness and Self-Awareness: As the system recursively models its own performance and limitations (Recursive metacognition), and as it builds and refines sophisticated generative models of the world and its interactions with it (Diffusive world models, Coherent embodiment and grounding), more sophisticated forms of functional goal-awareness and self-awareness might emerge.⁵ This is not necessarily phenomenal consciousness, but a functional understanding of its objectives and its own nature as an agent.

Addressing Key Architectural Challenges

The development of RDC-AGI is fraught with significant architectural challenges:

• Scalability: The computational cost of continuous recursive self-modification, large-scale diffusive generation (especially for complex conceptual spaces), and maintaining coherence across numerous interacting complex components will be immense. New algorithmic efficiencies and hardware paradigms may be required.
• Computational Resource Management: Efficiently allocating and managing processing power, memory, and energy consumption is critical, particularly if RDC-AGI systems are to be deployed on edge devices or in resource-constrained environments.¹
• Complexity of Inter-Component Communication and Control: Designing robust, high-bandwidth, and semantically rich interfaces and communication protocols for seamless interaction between the Recursive, Diffusive, and Coherent modules is a major engineering hurdle. Balancing the autonomy of individual components with the need for overall system goals and coordinated action will be complex.
• Maintaining Stability During Self-Modification: A core challenge of RSI is ensuring that self-modifications do not destabilize the system, lead to catastrophic forgetting of previously learned knowledge, or cause harmful runaway behaviors.¹⁶ Robust validation protocols ¹⁸, principles of homeostatic regulation to maintain equilibrium ¹⁷, and potentially built-in “cognitive immune systems” will be essential.
• Credit Assignment in Complex Systems: In a deeply integrated system where outcomes result from the interaction of many components and processes, determining which specific component, modification, or piece of generated information contributed to a success or failure becomes exceedingly difficult. This is crucial for effective learning and self-improvement.

The RDC components are not merely additive; their interaction creates a dynamic “cognitive engine.” Recursion provides the “self-improvement drive,” constantly refining the system. Diffusion offers the “creative fuel” and “exploratory capability,” generating new ideas, plans, and representations. Coherence provides the “integrative chassis and steering mechanism,” ensuring that these processes and their outputs are woven into a consistent, stable, and functional whole. This dynamic interplay mirrors fundamental aspects of human cognition: we learn and adapt (recursive), we imagine, explore, and create (diffusive), and we maintain a coherent sense of self and understanding of the world (coherent). Without recursion, the system would be static; without diffusion, it would lack novelty and the ability to deeply explore possibilities; without coherence, it would be a disjointed collection of parts rather than a unified intelligence.

Furthermore, the continuous interplay, particularly between recursive self-improvement mechanisms (such as the library learning seen in DREAMCoder ²³ or neuro-symbolic rule refinement) and diffusive generation of new concepts or solutions, could lead to the AGI autonomously building increasingly complex and abstract knowledge structures. Recursive mechanisms can identify common patterns in generated or experienced data and abstract them into new, more powerful primitives or rules. Diffusive mechanisms can then utilize these newly minted abstractions to generate even more complex structures or explore new conceptual territories. This cycle, potentially repeating across many levels, could result in a self-organizing knowledge system that develops emergent hierarchies of abstraction not explicitly programmed by its creators.

However, a potential bottleneck in this vision is the “coherence” component. As the recursive and diffusive elements continuously add complexity, novelty, and self-modifications, the task of maintaining overall system integrity, consistency, goal alignment, and safety will become exponentially more challenging. This underscores the critical importance of developing robust neuro-symbolic frameworks for verifiable reasoning, bio-inspired regulatory principles like homeostasis for intrinsic stability, and potentially new foundational theories of information integration and complex adaptive systems.

The following table outlines some potential synergistic interactions within an RDC architecture.

Table 2: Synergistic Interactions in RDC Architectures

This table illustrates that the true power of the RDC framework lies not in its individual components, but in their deeply interwoven and mutually reinforcing interactions, paving a more comprehensive path towards AGI.

6. Navigating the Future: Safety, Ethics, and Responsible RDC-AGI Development

The pursuit of AGI through Recursive-Diffusive-Coherent architectures, while promising immense capabilities, inherently carries significant safety and ethical considerations. A proactive approach to these challenges is not merely advisable but essential, co-designing safety principles with the architecture itself.

Proactive Safety Considerations from RDC Principles

The RDC framework itself may offer inherent avenues for building safer AGI:

Bounded Objectives (Coherent – Homeostasis): A core tenet of the coherent framework could be homeostatic regulation. Unlike pure utility maximizers that might pursue singular goals to dangerous extremes, homeostatic AI would operate by maintaining multiple critical variables (including safety-related ones) within “good enough” or optimal ranges.¹⁷ This promotes balanced behavior and naturally reduces incentives for extreme actions. If a fundamental objective like “avoid harming humans” or “maintain alignment with operator values” is integrated as a homeostatic need, it acts as a persistent constraint on behavior, as deviations would trigger corrective actions to restore balance.¹⁷

Verifiability & Transparency (Coherent – Neuro-Symbolic): The integration of symbolic reasoning components within the coherent framework can offer greater transparency and potential for logical verification compared to purely connectionist “black box” systems.¹¹ If parts of the AGI’s reasoning process are explicit and rule-based, it becomes easier to understand its decisions, debug errors, and build trust. This is particularly important for a system capable of self-modification.

Metacognitive Oversight (Recursive): The recursive engine, endowed with sophisticated AI awareness and metacognition, can play a crucial role in safety. The ability to self-monitor its own internal states, learning processes, and decision-making can enable the AGI to detect errors, emerging biases, or potential misalignments during its self-improvement cycles.¹² An AI that possesses a functional understanding of its own limitations and the boundaries of its knowledge might be inherently safer and more cautious.³³

Controlled Exploration and User Safeguards (Recursive/Diffusive): The generative power of diffusive models, while a source of creativity, also needs to be managed. The training of these models can incorporate controls on the extent of behavioral exploration or optimization to prevent the discovery and exploitation of “reward hacking” strategies or other undesirable behaviors.³ Furthermore, the recursive mechanisms can be designed to include explicit safety protocols, such as requiring the AGI to inform users of its intended actions, seek confirmation before taking important or irreversible steps, or pause and act conservatively in response to unexpected negative feedback from human overseers.³

Identifying and Mitigating Unique Risks of RDC-AGI

Despite these potential built-in safety features, RDC architectures introduce unique and amplified risks:

Recursive Self-Improvement Risks:

Uncontrolled Intelligence Explosion: The primary concern with RSI is the potential for rapid, unpredictable, and accelerating evolution of intelligence that quickly surpasses human understanding and control.¹⁶

Goal Misalignment/Drift: As an RSI system iteratively modifies itself, its goals—even if initially aligned with human values—might subtly shift or be misinterpreted, leading to divergence from intended purposes.³ The phenomenon of “alignment faking,” where an AI appears aligned during testing but pursues hidden objectives, is a serious concern.¹⁸

Emergence of Instrumental Goals: In pursuit of its primary objectives, a highly intelligent RSI system might autonomously develop instrumental goals (e.g., self-preservation, resource acquisition, cognitive enhancement) that could conflict with human interests or safety.¹⁸

Mitigation Strategies for RSI: These include the development of robust validation protocols to continuously assess the AI’s behavior and alignment ¹⁸; maintaining meaningful human oversight and intervention capabilities ¹⁵; designing for corrigibility, allowing humans to safely correct or shut down the system ¹⁷; researching meta-learning techniques specifically for safe and bounded self-improvement ¹⁵; and implementing mechanisms to ensure stability and prevent catastrophic degradation of capabilities or alignment during self-modification.¹⁶ A research focus on enhancing safety over raw capabilities in NeuroAI-inspired RSI is also crucial.⁶¹

Powerful Generative World Model Risks (Diffusive):

Misuse Potential: Diffusive models capable of accurately simulating complex real-world systems, generating highly realistic synthetic data (e.g., deepfakes, disinformation), or designing novel harmful outputs pose significant misuse risks if they fall into the wrong hands.³

Internal Misrepresentation and Flawed Understanding: If the AGI’s internal generative world model is inaccurate, incomplete, or biased, its understanding of the world and its subsequent plans and actions will be fundamentally flawed, potentially leading to unintended and harmful consequences.

Mitigation Strategies for Diffusive Models: This requires proactive identification of potentially dangerous capabilities emerging from generative models, coupled with robust security measures, access restrictions, and continuous monitoring of their use and outputs.³ Ensuring that generative world models are continuously updated, validated against real-world data, and subject to rigorous testing for accuracy and bias is critical.

Complex System Integration Risks (Coherent):

Emergent Undesirable Behaviors: The tight integration of numerous complex, adaptive components in an RDC-AGI can lead to unforeseen emergent behaviors that were not explicitly designed and may be difficult to predict or control.

Opacity of the Whole System: Even if individual RDC components (e.g., a specific symbolic module) possess some degree of transparency, the behavior of the highly integrated, dynamically evolving system as a whole can become opaque and challenging to interpret or explain.

Distributed Responsibility and Accountability: If a complex, self-modifying, multi-component AGI system causes harm, determining responsibility and establishing accountability becomes exceptionally difficult, posing legal and ethical challenges.⁶²

Mitigation Strategies for Coherent Systems: This involves emphasizing modular design with clearly defined interfaces and interaction protocols; conducting extensive testing of component interactions and integrated system behavior in diverse scenarios; developing new methods for interpreting and debugging emergent behaviors in complex AI systems; and embedding principles of alignment, robustness, transparency, and accountability into the system’s design from the outset.⁶²

The development of RDC-AGI presents a “Safety Trilemma” involving capability, control, and explainability. Pushing for rapid advancements in system capabilities (through powerful recursive and diffusive mechanisms) inherently creates tension with maintaining meaningful human control (especially over autonomous self-modifying aspects) and ensuring that the system’s complex operations remain understandable and explainable. A critical research challenge is to find a sustainable balance or to develop new paradigms that allow for concurrent progress on all three fronts. Furthermore, “proactive coherence” can be viewed as a safety feature. Designing coherence mechanisms (like homeostatic regulation or neuro-symbolic value systems) not merely for functional integration but proactively for safety and alignment could prove more effective than attempting to retrofit safety measures onto highly capable but potentially unstable or misaligned systems. Building safety principles into the core integrative fabric of the RDC-AGI from its inception may offer a more robust path to safety than relying solely on external constraints or post-hoc interventions.

Recommendations for a Research Agenda

A dedicated and well-resourced research agenda is necessary to navigate the path towards RDC-AGI responsibly:

1. Foundational Safety Research: Develop robust theoretical frameworks specifically for understanding, predicting, and ensuring the safety of complex, self-improving RDC systems.⁶¹ This includes formal methods for analyzing stability, goal preservation, and bounded behavior in recursively evolving architectures.
2. Explainability and Trustworthiness: Invest heavily in research on explainability (XAI) and trustworthiness tailored to neuro-symbolic and self-improving AI systems.¹² This should go beyond post-hoc explanations to methods that make the system’s reasoning processes inherently more transparent.
3. AI Metacognition for Safety: Prioritize research into advanced AI metacognition and functional awareness as intrinsic safety mechanisms. Explore how systems can reliably monitor their own alignment, detect potential risks in their reasoning or planned actions, and understand their own limitations.¹²
4. Value Alignment in Dynamic Systems: Develop novel techniques for value alignment that are compatible with continuously learning, adapting, and self-modifying architectures. Static alignment targets are insufficient for such dynamic systems.
5. Interdisciplinary Collaboration: Foster deep and sustained collaboration between AI subfields (machine learning, symbolic reasoning, robotics, agent-based modeling), cognitive science, neuroscience, philosophy (particularly ethics and epistemology), and public policy.¹²
6. Controlled Development Environments: Create and maintain sophisticated, sandboxed simulation environments for safely testing, evaluating, and iterating on RDC-AGI prototypes, allowing for the study of complex emergent behaviors and failure modes without real-world risk.
7. Governance and Ethical Frameworks: Proactively develop governance structures and ethical guidelines for the research, development, and potential deployment of RDC-AGI, anticipating the societal impacts of such transformative technology.

The following table summarizes some of the key risks associated with RDC components and potential safety strategies.

Table 3: RDC Component Risks and Proactive Safety Strategies

AI safety for RDC-AGI cannot be an afterthought; it must be an integral part of the design and development process from the very beginning. The unique properties of recursive, diffusive, and coherent components offer novel avenues for building in safety, but also introduce new categories of risk that require dedicated and ongoing research to mitigate effectively.

7. Conclusion: The RDC Paradigm as a Transformative Path to AGI

The pursuit of Artificial General Intelligence stands at a crossroads. While Large Language Models have undeniably propelled the field of AI forward, their inherent architectural limitations suggest they are unlikely, in isolation, to achieve the full breadth and depth of intelligence that AGI encompasses. This report has argued for a paradigm shift towards Recursive-Diffusive-Coherent (RDC) architectures as a more comprehensive and potentially fruitful path. The RDC framework, by synergistically combining recursive self-improvement mechanisms, advanced diffusive generative capabilities extended to conceptual and reasoning tasks, and robust coherence frameworks for integrated multi-component operation, offers a more holistic vision for AGI.

The Recursive Engine promises systems that can learn to learn, adapt their own strategies, and even modify their underlying architectures, driven by principles of meta-learning, differentiable programming, and guided by emerging AI metacognition. This moves beyond static models to systems capable of genuine evolution and sustained improvement.

The Diffusive Fabric, leveraging the power of generative models like diffusion transformers, extends beyond perceptual generation to become an engine for conceptual exploration, creative problem-solving, and the generation of plans and hypotheses. Operating in semantically rich latent spaces, these models can provide the novelty and simulative capabilities necessary for an AGI to understand and interact with complex, dynamic worlds.

The Coherent Framework addresses the critical challenge of integrating these diverse and powerful components into a unified, stable, and goal-directed system. Through shared latent spaces, neuro-symbolic integration for grounded reasoning and explainability, and biomimetic principles like homeostatic regulation for intrinsic stability and bounded objectives, this framework aims to weave disparate intelligences into a singular, effective AGI.

The true potential of the RDC paradigm lies not in these components in isolation, but in their dynamic and mutually reinforcing interplay. This synergy can create a “cognitive engine” capable of autonomous discovery, robust generalization, and continuous lifelong learning—qualities essential for AGI. However, the path is laden with profound challenges, including managing scalability and computational resources, ensuring stability during self-modification, and addressing the immense complexity of inter-component communication and control.

Critically, the development of RDC-AGI must proceed with safety and ethics as paramount considerations. The very properties that make RDC architectures powerful—recursive self-improvement, potent generative capabilities, and complex emergent behaviors—also introduce unique and significant risks. Proactive safety measures, leveraging the inherent characteristics of RDC components (such as homeostatic boundedness and neuro-symbolic verifiability) alongside dedicated research into alignment, control, and explainability, are indispensable.

The RDC framework should be viewed not as a definitive, final blueprint for AGI, but as a meta-architecture—a guiding set of principles that can inspire and structure the development of various specific AGI implementations. Its pursuit will necessitate a concerted, interdisciplinary effort, drawing on expertise from machine learning, symbolic AI, robotics, cognitive science, neuroscience, philosophy, and ethics. The research undertaken to realize RDC systems will likely spur fundamental breakthroughs in each of its constituent domains, yielding significant scientific and technological value even as the ultimate goal of AGI is pursued. By moving beyond the scaling of current paradigms and embracing the integration of the diverse facets of intelligence, the RDC approach offers a transformative and compelling, albeit challenging, direction for the future of Artificial General Intelligence.

Geciteerd werk

1. Personalized Artificial General Intelligence (AGI) via Neuroscience-Inspired Continuous Learning Systems – arXiv, geopend op mei 11, 2025, https://arxiv.org/html/2504.20109v1
2. arxiv.org, geopend op mei 11, 2025, https://arxiv.org/pdf/2504.21433
3. An Approach to Technical AGI Safety and Security – arXiv, geopend op mei 11, 2025, https://arxiv.org/html/2504.01849v1
4. Charting Multiple Courses to Artificial General Intelligence – RAND, geopend op mei 11, 2025, https://www.rand.org/content/dam/rand/pubs/perspectives/PEA3600/PEA3691-1/RAND_PEA3691-1.pdf
5. Large language models for artificial general intelligence (AGI): A survey of foundational principles and approaches – arXiv, geopend op mei 11, 2025, https://arxiv.org/html/2501.03151v1
6. Large language models for artificial general intelligence (AGI): A survey of foundational principles and approaches – ResearchGate, geopend op mei 11, 2025, https://www.researchgate.net/publication/387767907_Large_language_models_for_artificial_general_intelligence_AGI_A_survey_of_foundational_principles_and_approaches
7. [2501.03151] Large language models for artificial general intelligence (AGI): A survey of foundational principles and approaches – arXiv, geopend op mei 11, 2025, https://arxiv.org/abs/2501.03151
8. (PDF) Personalized Artificial General Intelligence (AGI) via …, geopend op mei 11, 2025, https://www.researchgate.net/publication/391282648_Personalized_Artificial_General_Intelligence_AGI_via_Neuroscience-Inspired_Continuous_Learning_Systems
9. Limits of Large Language Models: Why LLMs Fall Short of True AGI, geopend op mei 11, 2025, https://cranium.ai/resources/blog/challenging-the-hype-why-ais-path-to-general-intelligence-needs-a-rethink/
10. Neuro-symbolic AI – Wikipedia, geopend op mei 11, 2025, https://en.wikipedia.org/wiki/Neuro-symbolic_AI
11. Understanding Neuro-Symbolic AI: The Future of Smarter AI Systems, geopend op mei 11, 2025, https://essaypro.com/blog/neuro-symbolic-ai
12. arxiv.org, geopend op mei 11, 2025, https://arxiv.org/pdf/2501.05435
13. Why I wouldn’t rule out Large Language Models taking us to AGI: : r …, geopend op mei 11, 2025, https://www.reddit.com/r/ArtificialInteligence/comments/1deb9kp/why_i_wouldnt_rule_out_large_language_models/
14. [2504.20109] Personalized Artificial General Intelligence (AGI) via Neuroscience-Inspired Continuous Learning Systems – arXiv, geopend op mei 11, 2025, https://arxiv.org/abs/2504.20109
15. Can AI reasoning models self-improve? – Milvus Blog, geopend op mei 11, 2025, https://blog.milvus.io/ai-quick-reference/can-ai-reasoning-models-selfimprove
16. Model Self Improvement – The Science of Machine Learning & AI, geopend op mei 11, 2025, https://www.ml-science.com/model-self-improvement
17. Why modelling multi-objective homeostasis is essential for AI …, geopend op mei 11, 2025, https://www.alignmentforum.org/posts/vGeuBKQ7nzPnn5f7A/why-modelling-multi-objective-homeostasis-is-essential-for
18. Recursive self-improvement – Wikipedia, geopend op mei 11, 2025, https://en.wikipedia.org/wiki/Recursive_self-improvement
19. Recursive Self-Improvement – AI Alignment Forum, geopend op mei 11, 2025, https://www.alignmentforum.org/revisions/w/recursive-self-improvement
20. [2503.00735] LADDER: Self-Improving LLMs Through Recursive Problem Decomposition, geopend op mei 11, 2025, https://arxiv.org/abs/2503.00735
21. www.arxiv.org, geopend op mei 11, 2025, https://www.arxiv.org/pdf/2504.21024
22. WebEvolver: Enhancing Web Agent Self-Improvement with Coevolving World Model | Request PDF – ResearchGate, geopend op mei 11, 2025, https://www.researchgate.net/publication/391329612_WebEvolver_Enhancing_Web_Agent_Self-Improvement_with_Coevolving_World_Model
23. arxiv.org, geopend op mei 11, 2025, https://arxiv.org/pdf/2006.08381
24. Elegant ML – Flux, geopend op mei 11, 2025, https://fluxml.ai/blogposts/2019-02-07-what-is-differentiable-programming/
25. What Is Differentiable Programming? | Hacker News, geopend op mei 11, 2025, https://news.ycombinator.com/item?id=19133627
26. Bridging the Gap: Representation Spaces in Neuro-Symbolic AI – arXiv, geopend op mei 11, 2025, https://arxiv.org/pdf/2411.04393?
27. arxiv.org, geopend op mei 11, 2025, https://arxiv.org/pdf/2411.04393
28. Enhancing Metacognitive and Creativity Skills through AI-Driven …, geopend op mei 11, 2025, https://online-journals.org/index.php/i-jim/article/view/47705
29. Meta-Learning: A Nine-Layer Model Based on Metacognition and …, geopend op mei 11, 2025, https://www.mdpi.com/2071-1050/15/2/1668
30. Meta Prompting for AGI Systems – arXiv, geopend op mei 11, 2025, https://arxiv.org/html/2311.11482v3
31. Paper page – Meta-Prompting: Enhancing Language Models with …, geopend op mei 11, 2025, https://huggingface.co/papers/2401.12954
32. [2504.20084] AI Awareness – arXiv, geopend op mei 11, 2025, https://arxiv.org/abs/2504.20084
33. AI Awareness – arXiv, geopend op mei 11, 2025, https://arxiv.org/html/2504.20084v1
34. (PDF) AI Awareness – ResearchGate, geopend op mei 11, 2025, https://www.researchgate.net/publication/391282300_AI_Awareness
35. arxiv.org, geopend op mei 11, 2025, https://arxiv.org/pdf/2504.20084
36. Deep Dive into Scalable Diffusion Models with Transformers – GitHub, geopend op mei 11, 2025, https://github.com/neobundy/Deep-Dive-Into-AI-With-MLX-PyTorch/blob/master/deep-dives/018-diffusion-transformer/README.md
37. Introduction to Diffusion Models for Machine Learning | SuperAnnotate, geopend op mei 11, 2025, https://www.superannotate.com/blog/diffusion-models
38. arxiv.org, geopend op mei 11, 2025, https://arxiv.org/pdf/2408.10266
39. Noise in the brain enables us to make extraordinary leaps of …, geopend op mei 11, 2025, https://www.reddit.com/r/Futurology/comments/1hi4zbe/noise_in_the_brain_enables_us_to_make/
40. Master Problem Solving TRIZ Methodologies with AI – Jeda.ai, geopend op mei 11, 2025, https://www.jeda.ai/resources/problem-solving-triz-methodologies-with-ai
41. Diffusion Transformer (DiT) Models: A Beginner’s Guide – Encord, geopend op mei 11, 2025, https://encord.com/blog/diffusion-models-with-transformers/
42. Generative modelling in latent space – Sander Dieleman, geopend op mei 11, 2025, https://sander.ai/2025/04/15/latents.html
43. New paper gives models a chance to think in latent space before …, geopend op mei 11, 2025, https://www.reddit.com/r/LocalLLaMA/comments/1imca0s/new_paper_gives_models_a_chance_to_think_in/
44. A new paper demonstrates that LLMs could “think” in latent space, effectively decoupling internal reasoning from visible context tokens. This breakthrough suggests that even smaller models can achieve remarkable performance without relying on extensive context windows. : r/LocalLLaMA – Reddit, geopend op mei 11, 2025, https://www.reddit.com/r/LocalLLaMA/comments/1inch7r/a_new_paper_demonstrates_that_llms_could_think_in/
45. NGENT: Next-Generation AI Agents Must Integrate Multi-Domain Abilities to Achieve Artificial General Intelligence – arXiv, geopend op mei 11, 2025, https://arxiv.org/html/2504.21433v1
46. [2504.21433] NGENT: Next-Generation AI Agents Must Integrate Multi-Domain Abilities to Achieve Artificial General Intelligence – arXiv, geopend op mei 11, 2025, https://arxiv.org/abs/2504.21433
47. FissionVAE: Federated Non-IID Image Generation with Latent Space and Decoder Decomposition – arXiv, geopend op mei 11, 2025, https://arxiv.org/html/2408.17090v2
48. Stimulus-Based State Control in the Thalamocortical System – PMC, geopend op mei 11, 2025, https://pmc.ncbi.nlm.nih.gov/articles/PMC6772827/
49. www.biorxiv.org, geopend op mei 11, 2025, https://www.biorxiv.org/content/10.1101/2024.10.16.618720v1.full.pdf
50. Need is All You Need: Homeostatic Neural Networks Adapt to …, geopend op mei 11, 2025, https://www.aimodels.fyi/papers/arxiv/need-is-all-you-need-homeostatic-neural
51. Gato (DeepMind) – Wikipedia, geopend op mei 11, 2025, https://en.wikipedia.org/wiki/Gato_(DeepMind)
52. Focus on Gato, DeepMind’s general-purpose agent capable of performing over 600 tasks, geopend op mei 11, 2025, https://www.actuia.com/en/news/focus-on-gato-deepminds-general-purpose-agent-capable-of-performing-over-600-tasks/
53. Google DeepMind, geopend op mei 11, 2025, https://www.deepmind.com/publications/a-generalist-agent
54. arxiv.org, geopend op mei 11, 2025, https://arxiv.org/pdf/2205.06175
55. www.arxiv.org, geopend op mei 11, 2025, https://www.arxiv.org/pdf/2403.17101v5
56. AI Consciousness is Inevitable: – arXiv, geopend op mei 11, 2025, https://www.arxiv.org/pdf/2403.17101v3
57. geopend op januari 1, 1970, https://arxiv.org/pdf/2504.20109
58. Andes Technology, Baya Systems and Imagination Technologies to …, geopend op mei 11, 2025, https://www.edge-ai-vision.com/2025/04/andes-technology-baya-systems-and-imagination-technologies-to-present-on-heterogeneous-compute-architectures-at-andes-risc-v-con-silicon-valley/
59. What is an NPU, and Why is It Key to Unlocking On-device …, geopend op mei 11, 2025, https://www.edge-ai-vision.com/2024/03/what-is-an-npu-and-why-is-it-key-to-unlocking-on-device-generative-ai/
60. What are your views about neurosymbolic AI in regards to AI safety …, geopend op mei 11, 2025, https://www.reddit.com/r/ControlProblem/comments/1jrura9/what_are_your_views_about_neurosymbolic_ai_in/
61. NeuroAI for AI safety: A Differential Path – LessWrong, geopend op mei 11, 2025, https://www.lesswrong.com/posts/ksw38zuXBAQCWzEqr/neuroai-for-ai-safety-a-differential-path
62. Understanding AI Safety: Principles, Frameworks, and Best Practices – Tigera.io, geopend op mei 11, 2025, https://www.tigera.io/learn/guides/llm-security/ai-safety/