finding
active
finding:168-of-4-096-a-1-features-are-dead-and-292-are-ultralow-density-leaving-3-636-for-analysis168 of 4,096 A/1 features are dead and 292 are ultralow density, leaving 3,636 for analysis
Characterizes the live vs dead feature distribution in the main autoencoder run
Source paper
extracted_from(2024) · Marc Carauleanu · Michael Vaiana · Judd Rosenblatt · Cameron Berg +1
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Most features dead in largest SAE, indicating room for improvement.
- Toy model in the abundant-capacity regime.
- Estimate based on labor hours and physical pieces; used to motivate economic cost analysis.
- Basic SAE performance metrics.
- C.5.1.
- Systematic comparison showing features are substantially more universal than neurons across models
- PC1 explains 82% of variance in factor analysis of 2224 data points across 6 scoring dimensionsfinding0.719Dimensions are not independent; composite score is the reliable signal; six dimensions useful for understanding how not how much
- Interpretation of cross-base transfer asymmetry.