question
active
question:how-do-clt-number-representations-relate-to-those-in-non-sparse-models-such-as-helical-representationsHow do CLT number representations relate to those in non-sparse models, such as helical representations?
Future work.
Source paper
extracted_fromNeighborhood — ranked by edge-count
Papers (1)
paper
- Replicating Circuit Tracing for a Simple Known Mechanism - Goodfireassociated_withmentions
Concepts (1)
concept
- Helical number representationsassociated_withGeometric number representations in non-sparse models.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Motivates the RN hypothesis by pointing to the unknown relational structure within high-dimensional representation vectors.
- Closing claim.
- Comparison of heatmaps.
- Sparse interpreter models may represent and decompose computational mechanisms differentlyclaim0.732Hinted by differences.
- Main conclusion.
- Open question.
- Neuroscience-motivated prediction.
- Recent work identifying cases where LLM features are not one-dimensionally linear, a caveat to the linearity hypothesis.