concept
active
concept:mutual-information

Mutual Information

Expected mutual information between future states and outcomes; equivalent to intrinsic value.

Neighborhood — ranked by edge-count

Concepts (4)

concept
  • The reduction in uncertainty about hidden states afforded by observing outcomes, motivating epistemic exploration.
  • Information Gain
    associated_with
    Reduction in uncertainty about hidden states or parameters, driving exploration.
  • Epistemic Value
    associated_with
    Expected information gain about hidden states; drives curiosity and novelty-seeking; mutual information term in expected free energy.
  • Bayesian Surprise
    associated_with
    KL divergence between prior and posterior beliefs; used in visual salience.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • The theoretical cap on cross-modal alignment determined by mutual information between input signals and model capacity
  • Multi Informationconcept0.795
    Multivariate information transmission (McGill 1954); a measure of total dependence among variables.
  • Information shared across all sources in PID.
  • Goal state achieved when cognitive glue (price system) enables coordination of individual/group plans
  • Information-theoretic measure (Edlund et al.) characterizing interdependencies in agent-environment systems.
  • Unique Informationconcept0.772
    Information held by one source but not others in PID.
  • Cooperationconcept0.769
    Competing or cooperating with neighbours; a plant behaviour.
  • Mutual Embeddingconcept0.767
    A reinforcing interlock between different materials, mentioned alongside Deep Interlock in West Dean construction.