method
active
method:residual-entropy

Residual Entropy

Matrix-based entropy H(X) of residual stream, measuring compression of representations across depth

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Entropyconcept0.830
    A measurable physical quantity representing disorder; its increase is dictated by the second law of thermodynamics.
  • Residual Streamconcept0.802
    Proposed pathway flowing through layers at each position; calculates K/V values that feed horizontal information flow.
  • Emotion feature persistence above and beyond the persistence expected from high variance explained alone, computed by subtracting median variance-matched probe persistence
  • Negative Entropyconcept0.765
    Schrödinger's concept that living systems maintain order by extracting 'negative entropy' (order) from environment, reconciling second law of thermodynamics.
  • entropy scalingconcept0.748
    How the entropy gain ΔS scales with perimeter length P
  • A measure of quantum entanglement between subsystems; invoked to show boundary unmeasurability from within.
  • Variant of basin entropy averaged only over boxes straddling multiple basin values.
  • Layer-40 activations with the component explained by compressed Gemini embeddings subtracted, isolating information not driven by surface text content