paper:doi-10-1162-netn-a-00018The graphical brain: Belief propagation and active inference
Original abstract (expand)
This paper considers functional integration in the brain from a computational perspective. We ask what sort of neuronal message passing is mandated by active inference-and what implications this has for context-sensitive connectivity at microscopic and macroscopic levels. In particular, we formulate neuronal processing as belief propagation under deep generative models. Crucially, these models can entertain both discrete and continuous states, leading to distinct schemes for belief updating that play out on the same (neuronal) architecture. Technically, we use Forney (normal) factor graphs to elucidate the requisite message passing in terms of its form and scheduling. To accommodate mixed generative models (of discrete and continuous states), one also has to consider link nodes or factors that enable discrete and continuous representations to talk to each other. When mapping the implicit computational architecture onto neuronal connectivity, several interesting features emerge. For example, Bayesian model averaging and comparison, which link discrete and continuous states, may be implemented in thalamocortical loops. These and other considerations speak to a computational connectome that is inherently state dependent and self-organizing in ways that yield to a principled (variational) account. We conclude with simulations of reading that illustrate the implicit neuronal message passing, with a special focus on how discrete (semantic) representations inform, and are informed by, continuous (visual) sampling of the sensorium. AUTHOR SUMMARY: This paper considers functional integration in the brain from a computational perspective. We ask what sort of neuronal message passing is mandated by active inference-and what implications this has for context-sensitive connectivity at microscopic and macroscopic levels. In particular, we formulate neuronal processing as belief propagation under deep generative models that can entertain both discrete and continuous states. This leads to distinct schemes for belief updating that play out on the same (neuronal) architecture. Technically, we use Forney (normal) factor graphs to characterize the requisite message passing, and link this formal characterization to canonical microcircuits and extrinsic connectivity in the brain.
Related work— refs + corpus + external arXiv
Cited / in-corpus / arXiv badges show which signals surfaced each row. Multi-source rows weighted higher.
- ≈ 78%
- Learning Perception and Planning with Deep Active InferenceTim Verbelen, Johannes Nauta, Cedric De Boom and Bart Dhoedt Ozan \c{C}atal2020≈ 76%
- Neural representation in active inference: using generative models to interact with -- and understand -- the lived worldLeo D'Amato, Francesco Mannella, Matteo Priorelli, Toon Van de Maele, Ivilin Peev Stoianov, Karl Friston Giovanni Pezzulo2023≈ 76%
- Neuroscience-inspired perception-action in robotics: applying active inference for state estimation, control and self-perceptionMarcel van Gerven Pablo Lanillos2021≈ 76%
- How does the primate brain combine generative and discriminative computations in vision?James J. DiCarlo, Todd Gureckis, Ralf Haefner, Leyla Isik, Joshua Tenenbaum, Talia Konkle, Thomas Naselaris, Kimberly Stachenfeld, Zenna Tavares, Doris Tsao, Ilker Yildirim, Nikolaus Kriegeskorte Benjamin Peters2024≈ 76%
- Predictions in the eye of the beholder: an active inference account of Watt governorsChristopher L. Buckley, Jelle Bruineberg Manuel Baltieri2022≈ 76%
- Realising Active Inference in Variational Message Passing: the Outcome-blind Certainty SeekerMarek Grze\'s, Howard Bowman Th\'eophile Champion2021≈ 76%
- Graph Neural Networks in EEG-based Emotion Recognition: A SurveyYuqiu Deng, Yihao Wu, Ruizhi Yang, Zhongruo Wang, Liangwei Zhang, Siyun Chen, Tianyi Zhang, Yang Liu, Yi Ding, Liming Zhai, Ziyu Jia, and Xinliang Zhou Chenyu Liu2026≈ 75%
- Brain in the Dark: Design Principles for Neuro-mimetic Learning and InferenceSzymon Urbas, Karl Friston Mehran H. Bazargani2023≈ 75%
- ≈ 75%
- Integrating cognitive map learning and active inference for planning in ambiguous environmentsBart Dhoedt, Tim Verbelen, Giovanni Pezzulo Toon Van de Maele2023≈ 75%
- Active Inference in String Diagrams: A Categorical Account of Predictive Processing and Free EnergyJohannes Kleiner, Toby St Clere Smithe Sean Tull2023≈ 75%
- Abstracting Deep Neural Networks into Concept Graphs for Concept Level InterpretabilityParth Natekar, Ganapathy Krishnamurthi, Balaji Srinivasan Avinash Kori2022≈ 75%
- Active Inference in Robotics and Artificial Agents: Survey and ChallengesCristian Meo, Corrado Pezzato, Ajith Anil Meera, Mohamed Baioumy, Wataru Ohata, Alexander Tschantz, Beren Millidge, Martijn Wisse, Christopher L. Buckley, Jun Tani Pablo Lanillos2021≈ 75%
- ≈ 75%
- Active Inference: A Process Theoryin corpus2017≈ 74%
- ≈ 73%
- ≈ 72%
- ≈ 72%
- ≈ 71%
- The biogenic approach to cognitionin corpus2005≈ 71%
- ≈ 71%
- Cognitive glues are shared models of relative scarcities: the economics of collective intelligencein corpus2026≈ 71%
- Active inference: demystified and comparedin corpus2021≈ 71%
- ≈ 71%
- Collective intelligence: A unifying concept for integrating biology across scales and substratesin corpus2024≈ 71%
- Finding Alignments Between Interpretable Causal Variables and Distributed Neural Representationsin corpus2023≈ 71%
- The Platonic Representation Hypothesisin corpus2024≈ 70%
- The computational boundary of a 'self': developmental bioelectricity drives multicellularity and scale-free cognitionin corpus2019≈ 70%
- ≈ 70%
Similar preprints — Semantic Scholar
Cited by (5)
- Contemplative Agent
Embedding four Buddhist-derived axiomatic principles—mindfulness, emptiness, non-duality, and boundless care—into AI systems via a framework the paper terms the 'Wise World Model' produces measurable
- Active inference: demystified and compared
Active inference agents operating under expected free energy minimization achieve 98.90 [98.00, 99.79] average score in a non-stationary FrozenLake OpenAI gym environment, compared to 64.39 [60.33, 68
- Towards a computational phenomenology of mental action: modelling meta-awareness and attentional control with deep parametric active inference
- A tale of two densities: active inference is enactive inference
Ramstead, Kirchhoff, and Friston argue that generative models in active inference under the free energy principle (FEP) are control systems—not structural representations—and that this distinction has
- Active inference on discrete state-spaces: a synthesis
Active inference on discrete state-spaces, formalized as partially observable Markov decision processes (POMDPs) with likelihood matrix A, transition matrix B, and prior D, unifies perception, plannin