finding
active
finding:llama-e3-geometry-summary-s-max-1-896-0-211-aus-n-2-119-0-198-peak-layer-l-10-iqr-0-384LLaMA E3 geometry summary: S_max = −1.896 ± 0.211, AUS_N = −2.119 ± 0.198, peak layer ℓ* = 10 [IQR 0.384]
Seed-pooled geometry statistics for LLaMA in E3, providing quantitative basis for geometry-to-behavior correlate
Source paper
extracted_from(2025) · Edward Yi Chang · Kaya, Zeyneb N. · Ethan Chang
Neighborhood — ranked by edge-count
Hypotheses (1)
hypothesis
- E3 prediction that internal geometry provides a bridge to behavioral thresholds
Concepts (1)
concept
- Peak Layer-wise Anchoring Score (S_max)associated_withMaximum of S(ℓ) across layers; geometry summary used to predict θ50
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- LLaMA-3.1-8B: Sbmax = -1.896 ± 0.211, AUSN = -2.119 ± 0.198, peak layer ℓ* = 10 (median)finding0.883Seed-pooled geometry-only statistics (per-dev z units).
- Probe validation result confirming interest direction captures meaningful structure
- Connects this study's results to Schrimpf et al. 2021 and Caucheteux et al. 2022/2023 findings on brain-LLM alignment.
- Math and code tasks show strongest mid-layer anchoring on LLaMA (S ≈ −1.65 at layers 8-12)finding0.791Task-specific E3 finding showing compositional reasoning requires deeper processing
- Characterizes the narrow operating window in which ESR can manifest
- Validates representational drift theory: later layers specialize for next-token prediction, increasing dr
- Core empirical finding about layer-dependent truth direction emergence across task types.
- Multi-attempt improvement rate peaks at 83% around -1.0σ below threshold in Llama-3.3-70Bfinding0.776Shows slightly weaker steering allows more successful corrections, characterizing optimal ESR conditions