paper
active
paper:feucht-goodfire-geometric-calculator-2026A Geometric Calculator Inside a Neural Network
/Users/antonborzov/Documents/Research.nosync/papers/feucht-goodfire-geometric-calculator-2026.mdExternal IDs
arxiv
2605.01148title_hash
4e74859e058f60a0b72708dc74a6fdd745fd1647legacy_slug
feucht-goodfire-geometric-calculator-2026Frontmatter (19 fields)
{
"doi": "10.48550/arxiv.2605.01148",
"pdf": "https://arxiv.org/pdf/2605.01148",
"url": "https://arxiv.org/abs/2605.01148",
"tags": [
"mechanistic-interpretability",
"circuits",
"geometry-of-representations",
"Llama-3",
"circular-features",
"addition-circuit",
"goodfire"
],
"year": 2026,
"saved": "2026-05-14",
"title": "A Geometric Calculator Inside a Neural Network",
"venue": "arXiv preprint",
"status": "full-text-saved",
"authors": [
"Sheridan Feucht",
"Ekdeep Singh Lubana",
"Tal Haklay",
"Thomas Fel",
"Usha Bhalla",
"Atticus Geiger",
"Daniel Wurgaft",
"Can Rager",
"Raphaël Sarfati",
"Jack Merullo",
"Thomas McGrath",
"Owen Lewis"
],
"landing": "https://www.goodfire.ai/research/a-geometric-calculator",
"arxiv_id": 2605.01148,
"published": "2026-05-14",
"affiliation": "Goodfire (+ collaborators)",
"openalex_id": "W7160247613",
"openalex_year": 2026,
"openalex_enriched_at": 1778977723,
"openalex_match_title": "Arithmetic in the Wild: Llama uses Base-10 Addition to Reason About Cyclic Concepts",
"openalex_cited_by_count": 0
}Outgoing (2)
Implements (1)
- Base-10 Addition Mechanism in Llama(concept)
Member of (1)
- Neural Geometry(community)
Incoming (13)
Authored by (12)
- Atticus Geiger(thinker)
- Can Rager(thinker)
- Daniel Wurgaft(thinker)
- Ekdeep Singh Lubana(thinker)
- Jack Merullo(thinker)
- Owen Lewis(thinker)
- Raphaël Sarfati(thinker)
- Sheridan Feucht(thinker)
- Tal Haklay(thinker)
- Thomas Fel(thinker)
- Thomas McGrath(thinker)
- Usha Bhalla(thinker)
Cited by (1)
- arXiv:2605.05115(venue)
References (30)
- CausalGym: Benchmarking causal interpretability methods on linguistic tasksreferenced-only
- Language model circuits are sparse in the neuron basisreferenced-only
- Understanding neural networks through representation erasurereferenced-only
- Identifying and controlling important neurons in neural machine translationreferenced-only
- Gan dissection: Visualizing and understanding generative adversarial networksreferenced-only
- On the pitfalls of analyzing individual neurons in language modelsreferenced-only
- Locating and editing factual associations in GPTreferenced-only
- Progress measures for grokking via mechanistic interpretabilityreferenced-only
- Finding alignments between interpretable causal variables and distributed neural representationsreferenced-only
- Dissecting recall of factual associations in auto-regressive language modelsreferenced-only
- Discovering variable binding circuitry with desideratareferenced-only
- A geometric notion of causal probingreferenced-only
- The geometry of truth: Emergent linear structure in large language model representations of true/false datasetsreferenced-only
- Not all language model features are one-dimensionally linearreferenced-only
- The llama 3 herd of modelsreferenced-only
- Recurrent neural networks learn to store and generate sequences using non-linear representationsreferenced-only
- Representation shattering in transformers: A synthetic study with knowledge editingreferenced-only
- Emergent symbol-like number variables in artificial neural networksreferenced-only
- Language models use trigonometry to do additionreferenced-only
- Mib: A mechanistic interpretability benchmarkreferenced-only
- The origins of representation manifolds in large language modelsreferenced-only
- On the emergence of linear analogies in word embeddingsreferenced-only
- Alternating gradient flows: A theory of feature learning in two-layer neural networksreferenced-only
- What happens during the loss plateau? understanding abrupt learning in transformersreferenced-only
- How causal abstraction underpins computational explanationreferenced-only
- Why can't transformers learn multiplication? reverse-engineering reveals long-range dependency pitfallsreferenced-only
- Into the rabbit hull: From task-relevant concepts in dino to minkowski geometryreferenced-only
- Priors in time: Missing inductive biases for language model interpretabilityreferenced-only
- When models manipulate manifolds: The geometry of a counting taskreferenced-only
- Bi-orthogonal factor decomposition for vision transformersreferenced-only
Mentions (3)
- papers-typed
wurgaft-goodfire-manifold-steering-2026.md - papers
/Users/antonborzov/Documents/Research.nosync/papers/feucht-goodfire-geometric-calculator-2026.md - papers
feucht-goodfire-geometric-calculator-2026-fulltext.md