concept
active
concept:mutual-informationMutual Information
Expected mutual information between future states and outcomes; equivalent to intrinsic value.
Neighborhood — ranked by edge-count
Concepts (4)
concept
- Information Gain / Mutual Informationrelated_toThe reduction in uncertainty about hidden states afforded by observing outcomes, motivating epistemic exploration.
- Information Gainassociated_withReduction in uncertainty about hidden states or parameters, driving exploration.
- Epistemic Valueassociated_withExpected information gain about hidden states; drives curiosity and novelty-seeking; mutual information term in expected free energy.
- Bayesian Surpriseassociated_withKL divergence between prior and posterior beliefs; used in visual salience.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The theoretical cap on cross-modal alignment determined by mutual information between input signals and model capacity
- Multivariate information transmission (McGill 1954); a measure of total dependence among variables.
- Information shared across all sources in PID.
- Goal state achieved when cognitive glue (price system) enables coordination of individual/group plans
- Information-theoretic measure (Edlund et al.) characterizing interdependencies in agent-environment systems.
- Information held by one source but not others in PID.
- Competing or cooperating with neighbours; a plant behaviour.
- A reinforcing interlock between different materials, mentioned alongside Deep Interlock in West Dean construction.