hypothesis
active
hypothesis:phrases-like-okay-so-the-user-has-asked-a-question-about-were-so-common-in-r1-s-training-traces-that-the-model-treats-them-as-part-of-the-prompt

Phrases like 'Okay, so the user has asked a question about…' were so common in R1's training traces that the model treats them as part of the prompt

Explanation for late steering and attention sinks.

Source paper

extracted_from
Under the Hood of a Reasoning Model - Goodfire
Dron Hazra

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.