method
active
method:base-model-probing

base model probing

Method of using base models (no post-training) to observe spontaneous self-referential behaviors without confound of memorized introspection language.

Neighborhood — ranked by edge-count

Concepts (1)

concept

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Probing Methodsmethod0.799
    Top-down interpretability approach studying linguistic properties at various residual stream stages; contrasted with the paper's bottom-up mechanistic approach
  • Probingmethod0.797
    Standard interpretability technique used to read feature beliefs.
  • Earlier interpretability method applying classifiers to DNN hidden representations; shares complexity-accuracy dilemma with causal abstraction
  • Probing approach avoiding supervision to sidestep complexity-accuracy tradeoff
  • Attention probe predicting whether an Entity is hallucinated; AUC .94 on validation.
  • Probesconcept0.748
    Interpretability tools that decode information from internal model activations; here, linear probes are used for data attribution.
  • Sparse Probingmethod0.748
    Method from Gurnee et al. 2023 for finding feature directions including individual neuron analysis
  • Adaptation of instruction-tuned extraction to base models using third-person descriptions and hypothetical situations