concept
active
concept:information-gain-mutual-informationInformation Gain / Mutual Information
The reduction in uncertainty about hidden states afforded by observing outcomes, motivating epistemic exploration.
Neighborhood — ranked by edge-count
Concepts (2)
concept
- Information Gainrelated_toReduction in uncertainty about hidden states or parameters, driving exploration.
- Mutual Informationrelated_toExpected mutual information between future states and outcomes; equivalent to intrinsic value.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Economic concept related to epistemic value in expected free energy; information needed to realize rewards
- The puzzle that computation appears to gain information despite logical closure; resolved by relative to subsystems/observers.
- Information-theoretic measure (Edlund et al.) characterizing interdependencies in agent-environment systems.
- Expected KL divergence between updated and current posterior over model parameters.
- Expected information gain about hidden states, driving curiosity.
- Claim referencing Wittgenstein and later work that meaning of information depends on context.
- Proposed theoretical framework combining qualitative and quantitative aspects of information, with explicit treatment of processes and information flow; central organizing concept for the paper.
- Information theory offers a language to characterize such entities and synergies between them.claim0.738Claim that information-theoretic measures are suitable to model self and agency.