concept
active
concept:same-set-suppression

Same-set suppression

Head suppresses attention between related items, e.g., country and its own cities.

Neighborhood — ranked by edge-count

Concepts (1)

concept
  • K-Composition
    associated_with
    A form of attention head composition where W_K reads from a subspace affected by a previous head; central to how induction heads are implemented

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.