method
active
method:head-ranking-on-a-query-key-pair

Head ranking on a (query, key) pair

Ranks all heads by attention on a pair to trace composition.

Neighborhood — ranked by edge-count

Artifacts (1)

artifact
  • HeadVis
    implements
    Interactive tool for visualizing attention heads across the full data distribution; frontend open-sourced.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.