concept
active
concept:two-stage-cyclic-computationTwo-stage cyclic computation
Llama's discovered algorithm: first compute integer sum via base-10 addition, then map the sum back to cyclic concept space
Neighborhood — ranked by edge-count
Concepts (1)
concept
- Base-10 additionusesThe generic addition mechanism that Llama-3.1-8B actually uses to compute sums before mapping back to cyclic concept space
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The specific looped mechanism studied: a fixed sequence of layers repeated in a cyclic pattern
- Language model reasoning tasks with cyclic geometric structure used to test manifold steering.
- Architectural design principle that decouples rationale generation (stage 1) from answer inference (stage 2) in Multimodal-CoT.
- One of the geometric structures used to characterize reasoning task representations in language models, used as a test case for manifold steering
- Formalization of anchoring as posterior allocation over pattern clusters followed by output generation.
- The key theoretical contribution: each layer in a cyclic recurrence converges to a distinct fixed point, tracing a consistent trajectory in latent space
- Running example used throughout the paper; months cycle with period 12
- Experimental paradigm using prompts like 'what month is six months after August?' to study model arithmetic