question

active

question:what-is-the-nature-of-the-shared-model-space-or-lexicon-that-enables-naive-agents-to-properly-implement-received-priors-from-experienced-agents

What is the nature of the shared model space or lexicon that enables naive agents to properly implement received priors from experienced agents?

Prerequisite for model-level communication; raises issues of neural hermeneutics

Source paper

extracted_from

Active Inference, Curiosity and Insight

(2017) · Karl Friston · Marco Lin · Chris Frith · Giovanni Pezzulo +2

Neighborhood — ranked by edge-count

Claims (1)

claim

The results of abductive reasoning (reduced model priors) can be communicated to other agents as prior beliefs, provided all agents share the same model lexicon or hypothesis space.
gates
Explanation of how knowledge (not just parameters) is shared between agents; links to pre-Cartesian consciousness

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

What are the neuronal mechanisms by which prior beliefs from one agent's model are received and properly implemented by a naive agent (neuronal hermeneutics)?question0.811
Open question about inter-agent communication beyond model-space assumption
A naive agent equipped with reduced priors from an experienced agent performs perfectly with maximum confidence from the first trial.finding0.801
Demonstration that model-level priors (not parameter-level knowledge) suffice for immediate transfer
All intelligent agents, regardless of their substrate, can be understood as needing to respond to a perceived mismatch between what is and what should be.claim0.764
Foundation for the SCI loop model.
It's tricky, because for a typical language model the entity is sort of tricameral: the base simulator, the simulated simulator, and the simulated awareness.quote0.762
Antra's earlier definitive statement of the tricameral model.
Towards Monosemanticity: Decomposing Language Models with Dictionary Learning (Bricken et al., 2023)concept0.760
Foundational SAE mechanistic interpretability paper
In some sense, this is the simplest language model we profoundly don't understand. And so it makes a natural target for our paper.quote0.759
Articulates why a one-layer transformer with MLP is the appropriate starting target for mechanistic interpretability
Agents perceive by minimizing variational free energy to ensure model consistency with past observations and act by minimizing expected free energy to make future sensations consistent with preferences.claim0.756
Formalization of perception-action cycle integrating inference and decision-making.
The two-dimensional subspace reported by Burger et al. (2024) seems to reflect a stage of transition in the model's processing, rather than a universal property of truth directions.quote0.755
Load-bearing interpretive claim about the layer-specificity of Burger et al.'s finding.