paper:doi-10-3389-fncom-2016-00056Scene Construction, Visual Foraging, and Active Inference
Original abstract (expand)
This paper describes an active inference scheme for visual searches and the perceptual synthesis entailed by scene construction. Active inference assumes that perception and action minimize variational free energy, where actions are selected to minimize the free energy expected in the future. This assumption generalizes risk-sensitive control and expected utility theory to include epistemic value; namely, the value (or salience) of information inherent in resolving uncertainty about the causes of ambiguous cues or outcomes. Here, we apply active inference to saccadic searches of a visual scene. We consider the (difficult) problem of categorizing a scene, based on the spatial relationship among visual objects where, crucially, visual cues are sampled myopically through a sequence of saccadic eye movements. This means that evidence for competing hypotheses about the scene has to be accumulated sequentially, calling upon both prediction (planning) and postdiction (memory). Our aim is to highlight some simple but fundamental aspects of the requisite functional anatomy; namely, the link between approximate Bayesian inference under mean field assumptions and functional segregation in the visual cortex. This link rests upon the (neurobiologically plausible) process theory that accompanies the normative formulation of active inference for Markov decision processes. In future work, we hope to use this scheme to model empirical saccadic searches and identify the prior beliefs that underwrite intersubject variability in the way people forage for information in visual scenes (e.g., in schizophrenia).
Related work— refs + corpus + external arXiv
Cited / in-corpus / arXiv badges show which signals surfaced each row. Multi-source rows weighted higher.
- ≈ 76%
- Object-Centric Scene Representations using Active InferenceTim Verbelen, Pietro Mazzaglia, Stefano Ferraro, Bart Dhoedt Toon Van de Maele2023≈ 76%
- Learning Perception and Planning with Deep Active InferenceTim Verbelen, Johannes Nauta, Cedric De Boom and Bart Dhoedt Ozan \c{C}atal2020≈ 75%
- Active inference and artificial reasoningLancelot Da Costa, Alexander Tschantz, Conor Heins, Christopher Buckley, Tim Verbelen, Thomas Parr Karl Friston2025≈ 75%
- ≈ 75%
- ≈ 75%
- Exploring and Learning Structure: Active Inference Approach in Navigational AgentsDaria de Tinguy and Tim Verbelen and Bart Dhoedt2025≈ 74%
- ≈ 74%
- ≈ 74%
- On Predictive planning and counterfactual learning in active inferenceTakuya Isomura, Adeel Razi Aswin Paul2024≈ 73%
- Active inference for action-unaware agentsKeisuke Suzuki, Ryota Kanai, Manuel Baltieri Filippo Torresan2025≈ 73%
- Social Reality Construction via Active Inference: Modeling the Dialectic of Conformity and CreativityTakato Horii Kentaro Nomura2026≈ 73%
- Navigation and Exploration with Active Inference: from Biology to IndustryTim Verbelen, Bart Dhoedt Daria de Tinguy2025≈ 73%
- Expanding the Active Inference Landscape: More Intrinsic Motivations in the Perception-Action LoopChristian Guckelsberger (2), Christoph Salge (3 and 4), Sim\'on C. Smith (4 and 5), Daniel Polani (4) ((1) Araya Inc., Tokyo, Japan, (2) Computational Creativity Group, Department of Computing, Goldsmiths, University of London, London, UK, (3) Game Innovation Lab, Department of Computer Science and Engineering, New York University, New York City, NY, USA, (4) Sepia Lab, Adaptive Systems Research Group, Department of Computer Science, University of Hertfordshire, Hatfield, UK, (5) Institute of Perception, Action and Behaviour, School of Informatics, The University of Edinburgh, UK) Martin Biehl (1)2018≈ 73%
- Active Inference or Control as Inference? A Unifying ViewAbraham Imohiosen, Jan Peters Joe Watson2020≈ 73%
- ≈ 72%
- Active inference: demystified and comparedin corpus2021≈ 71%
- Active Inference: A Process Theoryin corpus2017≈ 68%
- ≈ 68%
- Active Inference, Curiosity and Insightin corpus2017≈ 67%
- ≈ 66%
- ≈ 66%
- ≈ 65%
- Finger Exercises in Formal Concept Analysisin corpus2006≈ 65%
- ≈ 65%
- ≈ 65%
- Collective intelligence: A unifying concept for integrating biology across scales and substratesin corpus2024≈ 65%
- Learning without neurons in physical systemsin corpus2022≈ 65%
- The biogenic approach to cognitionin corpus2005≈ 65%
- ≈ 65%
Similar preprints — Semantic Scholar
Cited by (5)
- Active Inference, Curiosity and Insight
Minimizing expected variational free energy under a discrete-state Markov decision process generative model is sufficient to produce curiosity, epistemic learning, and insight without any additional m
- Active inference: demystified and compared
Active inference agents operating under expected free energy minimization achieve 98.90 [98.00, 99.79] average score in a non-stationary FrozenLake OpenAI gym environment, compared to 64.39 [60.33, 68
- Active Inference: A Process Theory
A single variational principle—minimizing variational free energy via gradient descent on a Markov decision process (MDP) generative model—is sufficient to derive neuronal dynamics that reproduce, wit
- Towards a computational phenomenology of mental action: modelling meta-awareness and attentional control with deep parametric active inference
- Active inference on discrete state-spaces: a synthesis
Active inference on discrete state-spaces, formalized as partially observable Markov decision processes (POMDPs) with likelihood matrix A, transition matrix B, and prior D, unifies perception, plannin