claim
active
claim:averaging-acts-as-a-low-pass-filter-that-smooths-away-per-token-detail-and-retains-broad-conceptsAveraging acts as a low-pass filter that smooths away per-token detail and retains broad concepts
Intuition.
Source paper
extracted_from(2026) · Kevin Der · Harish Kamath · Thompson, Ben
Neighborhood — ranked by edge-count
Papers (1)
paper
Findings (1)
finding
- Table 1.
Concepts (1)
concept
- Turn averaging as low-pass filterassociated_withIntuition for why averaging yields high-level features.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- §5.5.
- Core intuition.
- Prediction from coverage results.
- Example A.
- Example C.
- LongBench v2 example E.
- Future work direction.
- Choosing token indices to sample adaptively, as in optimal experiment design, could be more efficient than post-hoc smoothing.hypothesis0.773Future work.