concept
active
concept:temporal-difference-errorTemporal Difference Error
The formal RL quantity whose signed character is identified with valence in the paper's account
Neighborhood — ranked by edge-count
Frameworks (1)
framework
- Reinforcement LearningimplementsAlternative framework for agent behavior; based on reward maximization rather than free energy minimization.
Concepts (2)
concept
- Goal-Relative Prediction Erroranalogous_toThe signed directional computation of how actual outcomes compare to goal-specified targets; identified with valence
- Dopaminergic Reward Prediction Erroranalogous_toMidbrain dopamine neurons encoding TD error; the most extensively studied evaluative system
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- In active inference, distant future predictions are naturally less precise, leading to Bayes-optimal discounting without an explicit discount factor.
- Role in optimizing sensory states; unified treatment shows value-learning and perception share error-minimization principle.
- Method for extracting linear directions by subtracting mean activations of contrastive groups; used to define the Assistant Axis
- Lagged time series used to capture dynamical dependencies.
- The property that living structures contain intense contrast—far more than one imagines helpful; true opposites which annihilate each other when superimposed, creating differentiation that gives birth to something; contrast unifies rather than separates when used correctly
- Second category of giving false information: role-playing truth-telling but with incorrect information encoded in weights
- Multiple possible meanings for words like Alice, disambiguated by context; harder when grammar and meaning intertwine