concept
active
concept:boundary-headsBoundary heads
Attention heads whose QK twists count manifolds to detect approaching line end.
Neighborhood — ranked by edge-count
Papers (1)
paper
Concepts (1)
concept
- QK twistingimplementsQK rotates character count manifold to align with line width at an offset.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The property that living centers are formed and strengthened by boundaries which both separate and unite; the boundary must be of the same order of magnitude as the center being bounded and is itself made of centers
- Hypothesized heads that invert semantic meaning of features; not confirmed.
- Multiple boundary heads have distinct overlapping response curves that tile characters remainingfinding0.748Stereoscopic algorithm.
- Early-layer head counting characters since newline, found polysemantic.
- The spatiotemporal limit of the goals an agent can represent and pursue; equivalent to the cognitive light cone.
- Mechanistic circuits in transformers documented by Olsson et al. 2022, cited as evidence for pattern-repository assumption
- Transformer attention heads that could be recruited to extract different kinds of information (text vs. thoughts).