hypothesis
active
hypothesis:positional-signal-is-diffuse-because-the-model-encodes-group-positions-in-a-poorly-linearly-separable-way-for-middle-groups

Positional signal is diffuse because the model encodes group positions in a poorly linearly separable way for middle groups

Tested via probes.

Source paper

extracted_from
Mixing Mechanisms: How Language Models Retrieve Bound Entities In-Context
(2025) · Yoav Gur-Arieh · Mor Geva · Atticus Geiger

Neighborhood — ranked by edge-count

Methods (1)

method

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.