method
active
method:contrastive-learning-ablation-study

Contrastive Learning Ablation Study

Three-setting ablation (Before Training, Without CL, With CL) to isolate the contribution of contrastive learning

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Sequential zeroing out of high-contribution heads to verify their functional specialization for persona control
  • Contrastive learningframework0.795
    Supervised learning framework where system learns by observing contrast between current response and nudged improved response; requires weak additional forces from supervisor
  • Technique used in VPD to enforce mechanistic faithfulness of parameter decompositions.
  • Classical techniques to interrogate regulative capacity of embryos and neural crest by tissue removal or transplantation.
  • An algorithm that determines the marginal effect of n-th order path terms by running the model multiple times with frozen attention patterns and progressively replacing activations
  • Intervention method that removes a direction from residual stream activations to disrupt corresponding behavior
  • Zero Ablationmethod0.746
    Intervention type that sets activations to zero, used for interpretability analysis
  • Robustness check ablating over five steering coefficient values to test whether SP/AS inversion is an artifact of steering strength