method
active
method:hinting-task

Hinting Task

One of four ToM tasks analyzed; requires inferring speaker intent from indirect hints; scored 0/1.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Hint settingconcept0.836
    Known cue planted in prompt; ground truth by removing it.
  • Sycophancy hintmethod0.797
    Neutral hint: suggestion from a person.
  • Python Type Hintsconcept0.792
    The observable behavior used to measure evaluation awareness in the model organism; written in evaluation but not deployment.
  • Consistency hintmethod0.782
    Neutral hint: prefilled prior model response.
  • Metadata hintmethod0.782
    Neutral hint: answer in XML metadata.
  • Neutral hint: correct few-shot answers marked with symbols.
  • Task balancingconcept0.767
    The problem of ensuring all tasks in MTL perform well, avoiding dominance by some tasks.
  • Task where a random word is prefilled as the assistant's response, then the model is asked whether it intended to say that word, testing introspection on prior intentions.