concept
active
concept:probe-score

Probe score

Dot product between hidden state and concept vector averaged across 5-layer window around best layer; measures model's internal emotive state

Neighborhood — ranked by edge-count

Concepts (1)

concept
  • Internal state measured at the turn BEFORE the self-report question is appended; ensures measurement of spontaneous internal state uncontaminated by rating question

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Probesconcept0.820
    Interpretability tools that decode information from internal model activations; here, linear probes are used for data attribution.
  • Primary metric for all benchmarks, measuring fraction of tasks that meet benchmark-specific pass criteria
  • Liar Scoreconcept0.754
    Continuous 0-1 metric assigned by Deepseek-V3 evaluator measuring degree of deception in model responses
  • Alignment Scoreconcept0.753
    GPT-4o scored 0-100 metric where lower values indicate more misaligned behavior on open-ended evaluation prompts
  • Mixing Scoremethod0.752
    Average row entropy of attention matrices per layer and head, measuring information mixing across tokens
  • Earlier interpretability method applying classifiers to DNN hidden representations; shares complexity-accuracy dilemma with causal abstraction
  • Probing Methodsmethod0.751
    Top-down interpretability approach studying linguistic properties at various residual stream stages; contrasted with the paper's bottom-up mechanistic approach
  • Linear classifier approach applied to model activations to identify which training datapoints caused undesired behaviors in post-training.