method
active
method:residual-entropyResidual Entropy
Matrix-based entropy H(X) of residual stream, measuring compression of representations across depth
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- A measurable physical quantity representing disorder; its increase is dictated by the second law of thermodynamics.
- Proposed pathway flowing through layers at each position; calculates K/V values that feed horizontal information flow.
- Emotion feature persistence above and beyond the persistence expected from high variance explained alone, computed by subtracting median variance-matched probe persistence
- Schrödinger's concept that living systems maintain order by extracting 'negative entropy' (order) from environment, reconciling second law of thermodynamics.
- How the entropy gain ΔS scales with perimeter length P
- A measure of quantum entanglement between subsystems; invoked to show boundary unmeasurability from within.
- Variant of basin entropy averaged only over boxes straddling multiple basin values.
- Layer-40 activations with the component explained by compressed Gemini embeddings subtracted, isolating information not driven by surface text content