finding
active
finding:preliminary-analyses-suggest-qk-attribution-matrices-per-head-and-position-pair-are-approximately-low-rank

Preliminary analyses suggest QK attribution matrices per head and position pair are approximately low-rank

Motivates distillation.

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.