concept
active
concept:high-rank-attentional-features

High-rank attentional features

Features whose QK/OV are high rank, hard to interpret.

Neighborhood — ranked by edge-count

Claims (1)

claim

Concepts (1)

concept
  • Attention biology
    associated_with
    Study of what attentional features and head behaviors exist.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.