finding
active
finding:llama-3-1-8b-sbmax-1-896-0-211-ausn-2-119-0-198-peak-layer-l-10-medianLLaMA-3.1-8B: Sbmax = -1.896 ± 0.211, AUSN = -2.119 ± 0.198, peak layer ℓ* = 10 (median)
Seed-pooled geometry-only statistics (per-dev z units).
Source paper
extracted_from(2025) · Edward Yi Chang · Kaya, Zeyneb N. · Ethan Chang
Neighborhood — ranked by edge-count
Claims (2)
claim
- Main interpretation of E3.
- Claim that geometry-to-behavior correlates exist
Communities (3)
community
- Few-shot anchoring & latent structuremembers_ofHow minimal examples disambiguate and recruit latent arithmetic/reasoning interpretations in LLMs
- Silhouette-based metrics (Sbmax, AUSN) across LLM layers predict task accuracy and few-shot thresholds.
- Quantifies relationships between layer-wise activation statistics (Sbmax, AUSN) and task performance metrics in LLMs, bridging internal representation geometry to behavioral outcomes.
Concepts (1)
concept
- Meta-Llama-3.1-8B-Instructassociated_withBackbone model used in E3 geometry analysis.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- LLaMA E3 geometry summary: S_max = −1.896 ± 0.211, AUS_N = −2.119 ± 0.198, peak layer ℓ* = 10 [IQR 0.384]finding0.883Seed-pooled geometry statistics for LLaMA in E3, providing quantitative basis for geometry-to-behavior correlate
- Math and code tasks show strongest mid-layer anchoring on LLaMA (S ≈ −1.65 at layers 8-12)finding0.816Task-specific E3 finding showing compositional reasoning requires deeper processing
- Connects this study's results to Schrimpf et al. 2021 and Caucheteux et al. 2022/2023 findings on brain-LLM alignment.
- Optimal activation capping layers for Llama 3.3 70B are layers 56-71 (out of 80) at 25th percentile capfinding0.809Specific implementation finding for Llama capping parameters
- Supporting finding showing ESR is driven by both higher multi-attempt rates and comparable improvement rates
- One of four LLMs selected for representation analysis; embedding dimension D=4096; used as demonstration model in scatter plots.
- The model used in Experiment 2 for SAE feature steering experiments via Goodfire API
- One of four LLMs selected; larger model with D=8192 embedding dimension; analyzed across proportionally aligned layers.