claim
active
claim:newline-feature-relies-on-attention-path-for-activation-signal-and-the-tokens-features-weight-negates-it-for-non-newline-tokens-effectiveness-highlights-inhibition

Newline feature relies on attention path for activation signal and the Tokens→Features weight negates it for non-newline tokens; effectiveness highlights inhibition

Circuit interpretation.

Source paper

extracted_from
Characterizing interference weights in a tiny language model
Nicholas L. Turner · Jeffrey Wu · Joshua Batson

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.