finding
active
finding:nmf-with-four-components-on-three-models-x-ten-layers-early-layers-later-layers-and-middle-layers-of-smallest-vs-larger-two-modelsNMF with four components on three models x ten layers: early layers, later layers, and middle layers of smallest vs larger two models
Scale-dependent middle-layer representations.
Source paper
extracted_fromNeighborhood — ranked by edge-count
Claims (1)
claim
- Interpretation of NMF result.
Questions (1)
question
- How do features change over model training; do they form abruptly or gradually, and do their directions drift?associated_withFresh-traction question.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Supporting signature for persona-model collapse: unconditioned moral profiles saturate near ceiling
- Layers where anchoring weakens systematically due to representational drift.
- SPD finds 102 W_in components and a rank-51 W_out component spanning all three layers in the 3-layer modelfinding0.751APD struggled beyond two layers.
- Explains why time and sequence are essential for generated complexity.
- Empirical demonstration of VPD on a mid-scale transformer, establishing feasibility.
- Architectural requirement from machine learning.
- Interpretation of E3 layer-wise results; motivates targeted UCCT interventions at layers 8-12
- Concurrent work result showing emergent misalignment occurs in small models