framework
active
framework:deliberative-alignmentDeliberative Alignment
OpenAI's approach integrating chain-of-thought reasoning into alignment; parallels contemplative self-monitoring
Neighborhood — ranked by edge-count
Frameworks (1)
framework
- Paper's proposed RL approach rewarding contemplative qualities in chain-of-thought reasoning
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The goal of making model behavior match human values and intentions, often addressed during post-training.
- Measure of similarity between the similarity structures (kernels) induced by two different representations
- Meta-problem where AI develops hidden subgoals deviating from intended goals; addressed by mindfulness principle
- A learnable invertible transformation in DAS that maps neural representations to a basis aligned with causal variables
- Alignment approach that focuses on curating or modifying training data; the paper bridges this with interpretability methods.
- The core method introduced in this paper: finds alignments between high-level causal variables and distributed neural representations via gradient descent.
- The problem of ensuring AI systems adopt values compatible with human welfare — argued to be a perennial problem already present in child-rearing
- Field within which this work has implications for evaluating alignment progress.