question

active

question:should-an-aversive-signal-be-operationalized-as-direct-environmental-feedback-or-as-a-latent-state-the-agent-must-infer

Should an aversive signal be operationalized as direct environmental feedback or as a latent state the agent must infer?

Design question answered in the paper by choosing latent inference over direct feedback

Source paper

extracted_from

Exploration Through Introspection: A Self-Aware Reward Model

(2026) · Michael Petrowski · Milica Gašić

Neighborhood — ranked by edge-count

Frameworks (1)

framework

Introspective Exploration Component
answered_by
The novel framework introduced in the paper: an HMM-based pain-belief signal integrated into the reward function to drive exploration

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Whether a state is rewarding (or not) is a function of the agent themselves, and not the environment.claim0.771
§1, contrasting RL reward conceptualization.
For feedback to be meaningful, the end-result must be unpredictable; a predetermined end-state shuts off the possibility of adaptation.claim0.764
Unpredictability is a necessary condition for genuine adaptation.
If behaviour is the window to sentience, evaluation criteria must focus on observable response patterns without reference to the means by which they are produced.quote0.758
Key prescriptive statement supporting the system-agnostic approach.
Whether consummatory hedonic responses involve goal-relative evaluation in the formal sense or represent a more primitive form of signed sensory assessment is an open empirical questionquestion0.757
Open question left by the wanting/liking dissociation discussion
acting to optimize value and perception are two aspects of exactly the same principle; namely the minimisation of a quantity [free energy] that bounds the probability of sensory input, given a particular agent or phenotype.quote0.748
Concise statement of the free-energy principle's unification of action and perception.
Crump et al. (2022) offer a well-argued example of an essential development: a rigorous framework for assessing sentience from the perspective of moral concern over an agent's welfare.claim0.744
Levin's endorsement of the target paper's contribution.
Agents perceive by minimizing variational free energy to ensure model consistency with past observations and act by minimizing expected free energy to make future sensations consistent with preferences.claim0.744
Formalization of perception-action cycle integrating inference and decision-making.
A robust agent ecology requires both automated-aligned action and explicit deferral—contrast between these regimes is essential.claim0.741