finding
active
finding:up-to-80-of-variance-of-x-t-is-explained-by-a-500-token-preceding-context-on-pile-samplesUp to 80% of variance of x_t is explained by a 500-token preceding context on Pile samples.
Fig. 2d,h.
Source paper
extracted_from(2025) · Lubana, Ekdeep Singh · Rager, Can · Hindupur, Sai Sumedh R. · Costa, Valerie +12
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
Findings (1)
finding
- Table 3.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Design choice validated empirically.
- §5.5.
- Shows that Burger et al.'s layer choice corresponds to a transitional phase, not a universal property.
- Contrasts with temporal permutation results; constitutes the most suggestive evidence of potential consciousness phenomena in LLM representations.
- Poisoning results.
- Prompt-level effect is much larger.
- Structure of the computational pathway.
- LongBench v2 example E.