concept
active
concept:fourier-features

Fourier features

Features identified in Llama-3.1-8B that compute sums using periods respecting base-10 addition (2, 5, 10) rather than concept-specific periods

Neighborhood — ranked by edge-count

Methods (1)

method

Concepts (4)

concept
  • Ringing
    associated_with
    Oscillating off-diagonal similarity from low-dimensional embedding of a curved manifold.
  • The core finding: Llama-3.1-8B reuses one addition mechanism across all cyclic tasks rather than learning task-specific modular arithmetic
  • MLP neurons
    implements
    The sparse set of 28 neurons at layer 18 identified as responsible for Fourier feature computation across all cyclic tasks

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.