concept
active
concept:alignment-functionAlignment Function
A learnable invertible transformation in DAS that maps neural representations to a basis aligned with causal variables
Neighborhood — ranked by edge-count
Frameworks (1)
framework
- Practical method by Geiger et al. for finding distributed causal abstractions using gradient descent
Concepts (1)
concept
- Alignmentrelated_toThe goal of making model behavior match human values and intentions, often addressed during post-training.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Learnable invertible transformation in DAS/MAS that rotates latent vectors into aligned subspaces; narrowed to orthogonal matrices Q.
- The only statistically significant predictor of koan battery scores (p=0.006); includes Constitutional AI, RLHF, SFT, roleplay, empathy
- The problem of ensuring AI systems adopt values compatible with human welfare — argued to be a perennial problem already present in child-rearing
- The bijective function mapping DNN inner neurons to latent variables in causal abstraction; its complexity is the central variable studied
- Measure of similarity between the similarity structures (kernels) induced by two different representations
- Field within which this work has implications for evaluating alignment progress.
- Baseline method that exhaustively searches discrete spaces of localist alignments between high-level variables and neuron groups.