concept
active
concept:information-gain

Information Gain

Reduction in uncertainty about hidden states or parameters, driving exploration.

Neighborhood — ranked by edge-count

Concepts (2)

concept
  • Information Gain / Mutual Information
    related_to
    The reduction in uncertainty about hidden states afforded by observing outcomes, motivating epistemic exploration.
  • Mutual Information
    associated_with
    Expected mutual information between future states and outcomes; equivalent to intrinsic value.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Value of Informationconcept0.803
    Economic concept related to epistemic value in expected free energy; information needed to realize rewards
  • information increase in computationconcept0.776
    The puzzle that computation appears to gain information despite logical closure; resolved by relative to subsystems/observers.
  • imperfect informationconcept0.753
    Game condition where players do not know the exact money values held by opponents, only counts.
  • Novelty (Information gain about parameters)concept0.752
    Expected KL divergence between updated and current posterior over model parameters.
  • The meaning of information is modulated by its use.claim0.747
    Claim referencing Wittgenstein and later work that meaning of information depends on context.
  • Interestconcept0.746
    Something that benefits or harms a being; tied to welfare subjectivity.
  • Information Dynamicsframework0.744
    Proposed theoretical framework combining qualitative and quantitative aspects of information, with explicit treatment of processes and information flow; central organizing concept for the paper.
  • Predictive Informationconcept0.739
    Bialek/Ay information-theoretic measure; characterizes agent capacity to predict future from past.