finding
active
finding:features-aligned-with-correct-answer-through-key-query-weights-are-other-relevant-content-features-near-orthogonal-in-residual-stream

Features aligned with 'correct answer' through key/query weights are other 'relevant content' features, near-orthogonal in residual stream

Supports monosemantic reading.

Neighborhood — ranked by edge-count

Hypotheses (1)

hypothesis

Methods (1)

method

Findings (1)

finding

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.