finding
active
finding:llama-3-1-8b-uses-task-agnostic-fourier-features-with-periods-2-5-and-10-base-10-rather-than-concept-specific-periods-e-g-12-for-monthsLlama-3.1-8B uses task-agnostic Fourier features with periods 2, 5, and 10 (base-10) rather than concept-specific periods (e.g., 12 for months)
The specific Fourier feature periods identified confirm base-10 rather than modular computation
Source paper
extracted_from(2026) · Sheridan Feucht · Tal Haklay · Usha Bhalla · Daniel Wurgaft +8
Neighborhood — ranked by edge-count
Claims (1)
claim
- Mechanistic claim linking identified Fourier features to base-10 arithmetic
Findings (1)
finding
- Fourier features with period 10 contribute to base-10 sum computation in the 28-neuron clustersupportsOne of the three base-10 Fourier periods identified in the sparse neuron set
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Llama-3.1-8B uses base-10 addition rather than modular addition to compute cyclic concept sumsfinding0.833The central empirical finding that computation does not mirror the circular representational structure
- The complete mechanistic algorithm discovered for cyclic concept reasoning
- Predictive hypothesis about domain-generality of the identified mechanism
- Key mechanistic finding showing task-agnostic reuse of arithmetic circuitry
- The specific computational question the paper resolves empirically
- Core empirical finding about layer-dependent truth direction emergence across task types.
- Empirical observation establishing that Llama's internal representations for days-of-week have circular geometric structure.
- Contrasts with 7B and 13B which show consistent summarization behavior; may complicate localization at 70B scale