quote
active
quote:an-addition-module-in-layer-18-of-llama-3-1-8b-performs-arithmetic-using-circular-geometric-representations-of-numbersAn addition module in layer 18 of Llama-3.1 8B performs arithmetic using circular geometric representations of numbers.
Verbatim summary of the main discovery.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Llama-3.1-8B uses base-10 addition rather than modular addition to compute cyclic concept sumsfinding0.830The central empirical finding that computation does not mirror the circular representational structure
- Predictive hypothesis about domain-generality of the identified mechanism
- The complete mechanistic algorithm discovered for cyclic concept reasoning
- Key mechanistic finding showing task-agnostic reuse of arithmetic circuitry
- The specific computational question the paper resolves empirically
- The representation geometry finding that motivates the question about whether computation mirrors it
- Core empirical result demonstrating that manifold steering produces on-target, behavior-aligned outputs.