paper:2021-10-18-prabros-1604-02603-pdf-6f9f31Information, Processes and Games
TL;DR
Information dynamics — a free-standing, syntax-independent science of informatic processes — requires unifying static/dynamic and qualitative/quantitative theories of information, and the paper's load-bearing contribution is the programme of showing how this unification can be achieved using three families of formal machinery: Scott Domain Theory, Game Semantics, and Geometry of Interaction. Coecke and Martin's construction of the Bayesian order on classical n-states (probability simplices Δₙ) and quantum states (density operators Ωₙ on n-dimensional Hilbert spaces Hₙ) provides the key bridge between Shannon entropy and Domain Theory: Shannon entropy μ(x) = −Σxᵢ log xᵢ is a measurement on the domain (Δₙ, ⊑), and von Neumann entropy S(ρ) = −tr(ρ log ρ) is a measurement on (Ωₙ, ⊑), with both domains' lattices of irreducible elements recovering exactly the Birkhoff–von Neumann quantum logics via Theorem 4.7. On the dynamic side, the paper introduces the partial involutions model — a particle-traversal Geometry of Interaction construction in which all combinators (B, C, I, K, W) are realised as partial involutions on a countably infinite set Pos of positions, with functional application defined via feedback composition f•g = f₂₂ ∪ f₂₁;g;(f₁₁;g)*;f₁₂, yielding a Linear Combinatory Algebra that embeds into a Standard Combinatory Algebra and hence a universal model of computation (Theorems 6.3 and 6.1). Game Semantics interprets the copy-cat strategy as the canonical proof of A ⊸ A in Multiplicative Linear Logic, linking conservation of information flow directly to logical tautology. The paper argues that this implies logical principles should be understood not as static truths but as conservation laws governing information flow between interacting agents, and that a mature Information Dynamics will subsume both computational complexity and the philosophy of information under a single geometric-logical framework.
What to take away
- 1. Coecke and Martin prove that the Bayesian order makes (Δₙ, ⊑) a domain whose least element is the uniform distribution (1/n, …, 1/n) and whose maximal elements are the pure states {eᵢ}, and that Shannon entropy μ(x) = −Σxᵢ log xᵢ is a measurement on this domain (Theorem 4.2).
- 2. The same construction lifts to quantum states: (Ωₙ, ⊑) is a domain with least element I/n and maximal elements Σₙ (pure states), and von Neumann entropy S(ρ) = −tr(ρ log ρ) is a measurement on it (Theorem 4.5).
- 3. The lattices of Birkhoff and von Neumann arise as order-duals of irreducible elements: Ir(Δₙ)* ≅ P{1,…,n}\{∅} (classical logic) and Ir(Ωₙ)* ≅ Lₙ\{0} (quantum logic), recovering the distributive/non-distributive distinction from the domain structure alone (Theorem 4.7).
- 4. The partial involutions model — the paper's central Geometry of Interaction construction — realises all Linear Combinatory Algebra combinators (B, C, I, K, W, D, δ, F) as partial involutions on a countably infinite position set Pos, with function application defined by the feedback formula f•g = f₂₂ ∪ f₂₁;g;(f₁₁;g)*;f₁₂.
- 5. By Theorem 6.3, any Linear Combinatory Algebra yields a Standard Combinatory Algebra under the substitution a·ₛb ≡ a·!b, and by Theorem 6.1 the partial recursive functions are exactly those numeralwise representable in CL, establishing that the partial involutions model is computationally universal.
- 6. The copy-cat strategy — copying opponent moves between two game boards — is proved to be a winning strategy for A⊥ ⅋ A (linear tautology A ⊸ A), making it a dynamic analogue of the classical tautology A ∨ ¬A and grounding logical principles as conservation laws for information flow.
- 7. Domain Theory, originating with Dana Scott c. 1970, is classified as a static qualitative theory, while Process Algebra (Milner's CCS, 1980) is the paper's first example of a genuinely dynamic qualitative theory that makes temporality and event flow explicit; Dynamic Logic (Pratt, 1976) is classified as static despite its name because it captures only input-output relations.
- 8. The paper raises the open hypothesis that polynomial-time computation and other complexity classes might be characterisable in a machine-independent, geometrical, non-inductive way analogous to how Game Semantics characterises programming disciplines (purely functional, stateful, non-deterministic, concurrent, etc.) without referring back to Turing machines.
- 9. To replicate the Bayesian order construction, one defines the base case on Δ₂ by x ⊑ y ≡ (y₁ ≤ x₁ ≤ 1/2) ∨ (1/2 ≤ x₁ ≤ y₁), then extends inductively to Δₙ₊₁ via the Bayesian projections pᵢ(x) = (x₁,…,x̂ᵢ,…,xₙ₊₁)/(1−xᵢ) by requiring x ⊑ y iff ∀i, pᵢ(x) ⊑ pᵢ(y) whenever both are defined (Definition 4.1).
- 10. The equational theory of strong bisimulation on CCS process terms is not finitely axiomatisable (Moller, LICS 1990), but a finite axiomatisation is achievable with the auxiliary left-merge operator, illustrating the persistent non-canonicity problem — the 'next 700 syndrome' — that the paper identifies as the fundamental challenge for Information Dynamics.
Peer brief — for seminar discussion
Abramsky's survey, written for a Handbook of Philosophy of Information, proposes the programme of Information Dynamics: a free-standing mathematical science of informatic processes that integrates qualitative structure, quantitative measure, and explicit dynamics. Rather than reporting experimental results, it maps out partial exemplifications of this programme across six formal frameworks and argues that their convergence points toward a unified theory. The paper does, however, introduce one technically specific construction — the partial involutions model of Geometry of Interaction — as a concrete instantiation of universal computation from pure copying, and it is this that constitutes the paper's most original formal contribution. The load-bearing finding is a cluster of three interlocking results. First, Coecke and Martin's Bayesian order places a domain structure on probability simplices Δₙ and on quantum state spaces Ωₙ such that Shannon entropy and von Neumann entropy respectively become domain measurements (Theorems 4.2 and 4.5). Second, the lattices of Birkhoff and von Neumann — the classical distributive lattice P{1,…,n} and the non-distributive quantum lattice Lₙ of closed subspaces of an n-dimensional Hilbert space Hₙ — are recovered as order-duals of irreducible elements of these domains (Theorem 4.7), unifying logic, probability, and order theory in one construction. Third, in the partial involutions model, combinators B, C, I, K, W are realised as partial involutions on a countably infinite set Pos of positions, functional application is defined by a feedback formula involving relational composition and reflexive transitive closure, and Theorems 6.3 and 6.1 together deliver computational universality: the partial recursive functions are exactly those representable in the resulting Standard Combinatory Algebra. The paper argues this implies that logical principles — the tautologies of Linear Logic and beyond — should be understood not as static truths but as conservation laws governing information flow between interacting agents, with the copy-cat strategy serving as the paradigm case: it is simultaneously a winning strategy for A ⊸ A in Multiplicative Linear Logic and a proof that mere copying is computationally universal. An alternative approach the paper could have used for the dynamic component is traced monoidal category theory (Joyal, Street, and Verity 1996), which the paper itself acknowledges as the general axiomatic home for Geometry of Interaction constructions; working directly in that setting would have given more categorical generality at the cost of immediate geometric concreteness. A critical reader would push back primarily on scope and evidentiary status: the paper presents Information Dynamics as a nascent field defined largely by what it is not yet, and the specific formal results — Coecke–Martin's domain structure on Δₙ and Ωₙ, the partial involutions model — are cited from pre-existing or concurrent work rather than proved here in full. The survey thus risks conflating the programme with its partial exemplifications, leaving unanswered the central question of whether a single unified framework can simultaneously handle quantitative rate-of-flow questions, the non-canonicity problem in concurrency (the 'next 700 syndrome'), and complexity-theoretic characterisations. The prediction that polynomial-time complexity classes might admit a geometrical, machine-independent characterisation analogous to Game Semantics' characterisation of programming disciplines remains entirely conjectural, with no formal constraints given on what such a characterisation would require.
Methods (3)
- bisimulationFundamental notion of process equivalence in labeled transition systems.
- Hindley-Milner algorithmAlgorithm for computing principal types of combinators/terms.
- Structural Operational SemanticsDefining transition relations by induction on syntax, introduced by Plotkin.
Frameworks (5)
- Bayesian orderThe partial order on classical probability distributions (Delta^n) that makes Shannon entropy a measurement on a domain.
- Hoare LogicCompositional proof system for imperative programs using pre/post-conditions.
- Kripke SemanticsPossible-worlds semantics for modal logics using Kripke structures.
- Quantum Logic (Birkhoff–von Neumann)Lattice of subspaces of Hilbert space as logic of quantum propositions.
- Shannon Information TheoryClassical quantitative theory of information; paper seeks to reconcile with qualitative domain-theoretic approaches.
Findings (9)
- Continuous functions in Domain Theory reflect that computational processes have access only to finite information at each finite stage.
Mathematical principle grounding the formal definition of continuity in domain theory to physical and epistemic constraints on computation.
- Least Fixpoint Theorem: A continuous function f on an ω-cpo with least element has a unique least fixpoint definable as ⊔ f^n(⊥).
Fundamental mathematical result in Domain Theory enabling rigorous treatment of recursive definitions and infinite computations as limits of finite information increase.
- Elements of domains form partially ordered information states where d ⊑ e means 'e conveys at least as much information as d'.
Core intuition of Domain Theory: qualitative ordering of information states provides foundation for modeling computation without quantification.
- Finite points and finite properties coincide in domains, enabling Stone duality between points and observable properties.
Theoretical insight explaining why domain theory permits creative ambiguity between ontological and epistemic interpretations of information states.
- Partial involutions form a Linear Combinatory Algebra under function application defined by feedback loops
The set of fixed-point free partial involutions on a countable set, with composition via interaction, yields a linear combinatory algebra, hence a universal model of computation.
- Omega^n of quantum states with spectral order is a domain and von Neumann entropy is a measurement
Quantum density operators, ordered by common observable's classical Bayesian order, form a dcpo with max elements pure states; von Neumann entropy is a measurement.
- Irreducibles of Delta^n and Omega^n yield classical and quantum propositional logics
The order dual of irreducibles recovers the Boolean lattice of nonempty subsets and the lattice of nonzero subspaces, respectively.
- Delta^n with Bayesian order is a domain and Shannon entropy is a measurement
The set of classical probability distributions, ordered by Bayesian projections, forms a dcpo with least element the uniform distribution and max elements pure states; Shannon entropy is a measurement of type Delta^n -> [0,∞).
- Copy-cat processes (partial involutions) are computationally universal
Mere copying of tokens between paired positions suffices to simulate all partial recursive functions and model higher-order logics.
Claims (14)
- Agents and their interactions are intrinsic to studying information flow in computation, not peripheral to classical information theory.
Central thesis: traditional static information theories fail to capture dynamic interaction necessary for understanding modern computing.
- Information increase in computation arises from data reduction and making implicit information explicit, not logical increase.
Author's proposed resolution to the information increase paradox: computation gains utility through extraction and filtering, not creation of logically new content.
- Information flow and increase must be understood relative to subsystems and their interaction with environment.
- The fundamental objects of study in information dynamics should be open systems interacting with an environment
Because information flow and increase are relative to subsystems, agents embedded in environments are the proper units of analysis.
- Information increase in computation is observer-dependent, relative to the computational direction chosen.
Extension of information dynamics: direction of information increase (e.g., forward multiplication vs. reverse factorization) depends on observer's goals.
- Much of the usefulness of computation lies in data reduction—removing the haystack to leave the needle
Normal forms are exponentially large; computing them makes explicit only necessary information while discarding most input data, explaining apparent information increase.
- The interactive processes described are reversible in a very strong sense, linking logic and physics
Partial involutions are invertible; the same structures can axiomatize quantum mechanics and analyse entanglement.
- The direction of information increase is relative to the observer or user of the computation
Example: 3×5→15 is a natural computation, but 15→3×5 (prime factorization) is also useful, showing that the 'gain' depends on the choice of normal form.
- Information can increase in computation only relative to subsystems and observers
The author argues that while total system information is conserved (thermodynamic), computation gains information for the observer by making implicit information explicit and discarding irrelevant data.
- Game semantics provides a setting for quantifying information flow between agents
The author sees potential to ask quantitative questions about rate of information flow through strategies, robustness, and minimal information disclosure.
Hypotheses (2)
- Future work should develop fully-fledged dynamic theories combining qualitative and quantitative information in the style of Game Semantics and Geometry of Interaction.
Paper identifies major research objective: extending static reconciliations (Domain Theory + Shannon) to dynamic frameworks.
- Partial orders naturally represent partial information states in computation.
Foundational hypothesis of Domain Theory: partial order structure (D, ⊑) captures information ordering without quantification.
Questions (5)
- What are the analogues to Turing-completeness and universality when we are concerned with processes and their behaviours?
Key open problem: foundational definitions for process models that match the role of Turing completeness for functional computation.
- Can we characterize polynomial-time computation and other complexity classes in such terms?
Hoping for machine-independent, geometrical characterizations of complexity classes via interaction models.
- How can information increase in computation if output is logically implied by input?
- Does information increase in computation?
Fundamental puzzle motivating the paper: how can computation produce new information when output is logically implied by input and thermodynamics suggests information cannot increase?
- What function does the Internet compute?
Critical puzzle showing inadequacy of classical function-based computational model for modern distributed, interactive systems without fixed input-output structure.
Related work— refs + corpus + external arXiv
Cited / in-corpus / arXiv badges show which signals surfaced each row. Multi-source rows weighted higher.
- The Poincar\'e-Boltzmann Machine: from Statistical Physics to Machine Learning and backPierre Baudot2019≈ 85%
- Integrated information as a common signature of dynamical and information-processing complexityFernando E. Rosas, Juan Carlos Farah, Murray Shanahan, Daniel Bor and Adam B. Barrett Pedro A.M. Mediano2022≈ 85%
- Measuring the integrated information of a quantum mechanismRobert Prentner, Ian Durham Larissa Albantakis2023≈ 84%
- ≈ 83%
- Information Theory in Open-world Machine Learning Foundations, Frameworks, and Future DirectionLin Wang2025≈ 83%
- ≈ 83%
- Elements of Consciousness and Cognition. Biology, Mathematic, Physics and Panpsychism: an Information Topology PerspectivePierre Baudot2018≈ 82%
- Information Must Flow: Recursive Bootstrapping for Information Bottleneck in Optimal TransportXin Li2025≈ 82%
- ≈ 82%
- Shannon information and integrated information: message and meaningAlireza Zaeemzadeh and Giulio Tononi2024≈ 82%
- ≈ 82%
- ≈ 82%
- Bounded rationality for relaxing best response and mutual consistency: The Quantal Hierarchy model of decision-makingMikhail Prokopenko Benjamin Patrick Evans2023≈ 82%
- Information as Maximum-Caliber Deviation: A bridge between Integrated Information Theory and the Free Energy PrincipleAlexander Kearney2026≈ 82%
- ≈ 82%
- ≈ 81%
- ≈ 80%
- ≈ 80%
- ≈ 80%
- ≈ 80%
- ≈ 79%
- Life as we know itin corpus2013≈ 79%
- Emergence and Causality in Complex Systems: A Survey on Causal Emergence and Related Quantitative Studiesin corpus2023≈ 79%
- ≈ 79%
- ≈ 78%
- Finger Exercises in Formal Concept Analysisin corpus2006≈ 78%
- Collective intelligence: A unifying concept for integrating biology across scales and substratesin corpus2024≈ 78%
- Design for an Individual: Connectionist Approaches to the Evolutionary Transitions in Individualityin corpus2022≈ 78%
- The biogenic approach to cognitionin corpus2005≈ 78%
- The logic of quantum mechanicscited1936≈ 71%
+29 more
Similar preprints — Semantic Scholar
Cross-corpus bridges (1)
same_concept_as · Nomic cosineExternal markdown files that talk about the same concept as this entity.
- alexander2021 10 18 Prabros. 1604.02603.pdf 6f9f31papers/extracted/2021-10-18_Prabros._1604.02603.pdf_6f9f31.md0.823