finding
active
finding:with-up-to-10-000-filler-tokens-lexical-effect-declines-while-positional-and-mixed-effects-increase-on-gemma-2-2b-it-boxes

With up to 10,000 filler tokens, lexical effect declines while positional and mixed effects increase on gemma-2-2b-it boxes

Long-context generalization.

Source paper

extracted_from
Mixing Mechanisms: How Language Models Retrieve Bound Entities In-Context
(2025) · Yoav Gur-Arieh · Mor Geva · Atticus Geiger

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.