concept
active
concept:alignment-scoreAlignment Score
GPT-4o scored 0-100 metric where lower values indicate more misaligned behavior on open-ended evaluation prompts
Neighborhood — ranked by edge-count
Papers (1)
paper
Concepts (1)
concept
- Alignmentrelated_toThe goal of making model behavior match human values and intentions, often addressed during post-training.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Rubric-based thresholded GPT-4o grader scoring responses 1-5 on evil intent; scores 4-5 counted as misaligned
- The problem of ensuring AI systems adopt values compatible with human welfare — argued to be a perennial problem already present in child-rearing
- A learnable invertible transformation in DAS that maps neural representations to a basis aligned with causal variables
- Field within which this work has implications for evaluating alignment progress.
- The bijective function mapping DNN inner neurons to latent variables in causal abstraction; its complexity is the central variable studied
- The only statistically significant predictor of koan battery scores (p=0.006); includes Constitutional AI, RLHF, SFT, roleplay, empathy
- Learnable invertible transformation in DAS/MAS that rotates latent vectors into aligned subspaces; narrowed to orthogonal matrices Q.