residual stream recovery tracking

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Residual Streamconcept0.833
  Proposed pathway flowing through layers at each position; calculates K/V values that feed horizontal information flow.
• Residual Stream Activationconcept0.825
  The intermediate representations in transformer layers whose activations are patched and probed for truth information
• Residual Stream Patchingmethod0.802
  Technique to localize causally implicated hidden states by swapping residual stream activations between a true and false input and measuring downstream log-probability changes
• Residual Stream Activation Patchingmethod0.802
  Used to localize causally implicated hidden states by swapping activations between true and false inputs
• Residual Stream Bandwidthconcept0.792
  The finite dimensional capacity of the residual stream for storing and communicating information between layers; conceptualized as being under high demand
• Residual-Stream Injectionconcept0.773
  Core activation intervention: add scaled vector to residual stream at layer l during completion
• Superposition in Residual Streamconcept0.749
  The phenomenon where the residual stream communicates many more features than its dimensionality by encoding information across overlapping subspaces
• layer 40 residual-stream activationsconcept0.747
  The specific neural network layer from which activations are extracted for probe construction and SAE training in the target models