finding
active
finding:168-of-4-096-a-1-features-are-dead-and-292-are-ultralow-density-leaving-3-636-for-analysis168 of 4,096 A/1 features are dead and 292 are ultralow density, leaving 3,636 for analysis
Characterizes the live vs dead feature distribution in the main autoencoder run
Source paper
extracted_from(2024) · Marc Carauleanu · Michael Vaiana · Judd Rosenblatt · Cameron Berg +1
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Most features dead in largest SAE, indicating room for improvement.
- Estimate based on labor hours and physical pieces; used to motivate economic cost analysis.
- Basic SAE performance metrics.
- Systematic comparison showing features are substantially more universal than neurons across models
- PC1 explains 82% of variance in factor analysis of 2224 data points across 6 scoring dimensionsfinding0.719Dimensions are not independent; composite score is the reliable signal; six dimensions useful for understanding how not how much
- Interpretation of cross-base transfer asymmetry.
- Statistical result confirming robustness of single-feature steering effects in Experiment 2
- Universality of DNA feature across two transformer models with different random seeds