Contrastive Activation Addition (CAA)

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Our method achieves superior performance compared to Contrastive Activation Addition.finding0.806
  Performance gains over CAA in steering tasks.
• Reflection Enhancement via Activation Additionmethod0.790
  Adding steering vector in forward direction to push model activations toward stronger reflective behavior.
• Activation Addition (ActAdd)framework0.779
  Steering method deriving vectors from contrastive prompt pairs and adding to first-token activations.
• Activation Additionmethod0.767
  Intervention method that adds a learned direction vector to residual stream activations to steer model behavior
• Ali et al. 2025 found contrastive activation addition less effective at larger model scale, consistent with ESR in 70Bfinding0.758
  Prior finding from related work that aligns with ESR being strongest in the largest model tested
• ActAdd (Activation Addition)concept0.745
  Method by Turner et al. for real-time output control via activation engineering, cited as foundation for this paper's steering approach
• Contrastive analysismethod0.730
  Method comparing brain activity in conscious vs. unconscious conditions.
• Contrastive Activation Steeringmethod0.729
  Core technique: takes mean difference of model activations on contrastive prompts and adds the resulting vector to the residual stream at inference time.