paper:doi-10-3389-fnhum-2013-00598The anatomy of choice: active inference and agency
Original abstract (expand)
This paper considers agency in the setting of embodied or active inference. In brief, we associate a sense of agency with prior beliefs about action and ask what sorts of beliefs underlie optimal behavior. In particular, we consider prior beliefs that action minimizes the Kullback-Leibler (KL) divergence between desired states and attainable states in the future. This allows one to formulate bounded rationality as approximate Bayesian inference that optimizes a free energy bound on model evidence. We show that constructs like expected utility, exploration bonuses, softmax choice rules and optimism bias emerge as natural consequences of this formulation. Previous accounts of active inference have focused on predictive coding and Bayesian filtering schemes for minimizing free energy. Here, we consider variational Bayes as an alternative scheme that provides formal constraints on the computational anatomy of inference and action-constraints that are remarkably consistent with neuroanatomy. Furthermore, this scheme contextualizes optimal decision theory and economic (utilitarian) formulations as pure inference problems. For example, expected utility theory emerges as a special case of free energy minimization, where the sensitivity or inverse temperature (of softmax functions and quantal response equilibria) has a unique and Bayes-optimal solution-that minimizes free energy. This sensitivity corresponds to the precision of beliefs about behavior, such that attainable goals are afforded a higher precision or confidence. In turn, this means that optimal behavior entails a representation of confidence about outcomes that are under an agent's control.
Related work— refs + corpus + external arXiv
Cited / in-corpus / arXiv badges show which signals surfaced each row. Multi-source rows weighted higher.
- Active Inference: A method for Phenotyping Agency in AI systems?Philip Wilson and Axel Constant and Mahault Albarracin and Nicol\'as Hinrichs and Jasmine Moore and Daniel Polani and Karl Friston2026≈ 79%
- Active Inference or Control as Inference? A Unifying ViewAbraham Imohiosen, Jan Peters Joe Watson2020≈ 79%
- ≈ 78%
- ≈ 78%
- Active inference and artificial reasoningLancelot Da Costa, Alexander Tschantz, Conor Heins, Christopher Buckley, Tim Verbelen, Thomas Parr Karl Friston2025≈ 78%
- Expanding the Active Inference Landscape: More Intrinsic Motivations in the Perception-Action LoopChristian Guckelsberger (2), Christoph Salge (3 and 4), Sim\'on C. Smith (4 and 5), Daniel Polani (4) ((1) Araya Inc., Tokyo, Japan, (2) Computational Creativity Group, Department of Computing, Goldsmiths, University of London, London, UK, (3) Game Innovation Lab, Department of Computer Science and Engineering, New York University, New York City, NY, USA, (4) Sepia Lab, Adaptive Systems Research Group, Department of Computer Science, University of Hertfordshire, Hatfield, UK, (5) Institute of Perception, Action and Behaviour, School of Informatics, The University of Edinburgh, UK) Martin Biehl (1)2018≈ 77%
- Active Inference in Robotics and Artificial Agents: Survey and ChallengesCristian Meo, Corrado Pezzato, Ajith Anil Meera, Mohamed Baioumy, Wataru Ohata, Alexander Tschantz, Beren Millidge, Martijn Wisse, Christopher L. Buckley, Jun Tani Pablo Lanillos2021≈ 76%
- Active Inference and Human--Computer InteractionJohn H. Williamson, Sebastian Stein Roderick Murray-Smith2024≈ 76%
- ≈ 76%
- ≈ 76%
- ≈ 76%
- Learning Perception and Planning with Deep Active InferenceTim Verbelen, Johannes Nauta, Cedric De Boom and Bart Dhoedt Ozan \c{C}atal2020≈ 76%
- Active inference for action-unaware agentsKeisuke Suzuki, Ryota Kanai, Manuel Baltieri Filippo Torresan2025≈ 76%
- ≈ 75%
- Active Inference for Autonomous Decision-Making with Contextual Multi-Armed BanditsShohei Wakayama and Nisar Ahmed2023≈ 75%
- Active inference: demystified and comparedin corpus2021≈ 72%
- ≈ 71%
- ≈ 71%
- Active Inference: A Process Theoryin corpus2017≈ 70%
- ≈ 69%
- ≈ 68%
- Active Inference, Curiosity and Insightin corpus2017≈ 68%
- Darwin's agential materials: evolutionary implications of multiscale competency in developmental biologyin corpus2023≈ 67%
- ≈ 67%
- ≈ 67%
- ≈ 67%
- Taking AI Welfare Seriouslyin corpus2024≈ 67%
- ≈ 66%
- ≈ 66%
Similar preprints — Semantic Scholar
Cited by (3)
- Active Inference, Curiosity and Insight
Minimizing expected variational free energy under a discrete-state Markov decision process generative model is sufficient to produce curiosity, epistemic learning, and insight without any additional m
- Active Inference: A Process Theory
A single variational principle—minimizing variational free energy via gradient descent on a Markov decision process (MDP) generative model—is sufficient to derive neuronal dynamics that reproduce, wit
- Technological Approach to Mind Everywhere: An Experimentally-Grounded Framework for Understanding Diverse Bodies and Minds
TAME—Technological Approach to Mind Everywhere—formalizes a non-binary, empirically grounded framework for recognizing, comparing, and manipulating cognition across radically diverse substrates, from