finding
active
finding:attention-sinks-in-r1-appear-toward-the-end-of-the-response-prefix-rather-than-at-the-start-of-responses

Attention sinks in R1 appear toward the end of the response prefix rather than at the start of responses

Suggests R1 does not model its true response as begun until after the prefix.

Source paper

extracted_from
Under the Hood of a Reasoning Model - Goodfire
Dron Hazra

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.