concept
active
concept:generic-addition-mechanismGeneric addition mechanism
The core finding: Llama-3.1-8B reuses one addition mechanism across all cyclic tasks rather than learning task-specific modular arithmetic
Neighborhood — ranked by edge-count
Concepts (3)
concept
- Base-10 additionimplementsThe generic addition mechanism that Llama-3.1-8B actually uses to compute sums before mapping back to cyclic concept space
- Fourier featuresimplementsFeatures identified in Llama-3.1-8B that compute sums using periods respecting base-10 addition (2, 5, 10) rather than concept-specific periods
- Task-agnostic mechanismassociated_withA computational mechanism reused across multiple tasks without specialization to any one domain
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Key mechanistic finding showing task-agnostic reuse of arithmetic circuitry
- Intervention method that adds a learned direction vector to residual stream activations to steer model behavior
- Steering method deriving vectors from contrastive prompt pairs and adding to first-token activations.
- The mathematically natural computation for cyclic concepts (e.g., addition mod 12 for months), which the paper shows Llama does NOT directly implement
- Adding steering vector in forward direction to push model activations toward stronger reflective behavior.