concept
active
concept:refusal-directionRefusal direction
Arditi et al. 2024 finding that refusal behavior is mediated by one direction in LLM activations; exemplar of single-direction causal results
Neighborhood — ranked by edge-count
Papers (2)
paper
Concepts (1)
concept
- Refusal Direction in LLMsrelated_toPrior finding that LLM refusal is mediated by a single latent direction, analogous to this paper's reflection direction.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- A hypothesized direction in LLM activation space that encodes the truth or falsehood of factual statements
- The percentage of harmful requests that a model refuses to answer, a common safety metric.
- A direction in the model's representation space that governs self-reflection behavior, computed as mean difference between reflection and non-reflection embeddings
- A geometric framework relating Big Five trait steering vector alignment with the refusal direction to predict activation-steering safety vulnerability on a per-model basis
- Paradigm of finding the right direction in activation space (e.g., linear steering).
- Single linear direction mediating refusal behavior in LLMs, shown by Arditi et al.; related to but distinct from the Assistant Axis
- Proposed universal invariant of cognition and intelligence—capacity for goal-directed activity in a problem space, independent of substrate or embodiment.
- Residual refusals after evil-vector transfer originate inside the model's chain-of-thought, not at input or decode level