concept
active
concept:alignment-problem

Alignment Problem

The problem of ensuring AI systems adopt values compatible with human welfare — argued to be a perennial problem already present in child-rearing

Neighborhood — ranked by edge-count

Claims (1)

claim

Concepts (2)

concept
  • Alignment
    related_to
    The goal of making model behavior match human values and intentions, often addressed during post-training.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Alignment Functionconcept0.830
    A learnable invertible transformation in DAS that maps neural representations to a basis aligned with causal variables
  • Alignment Scoreconcept0.821
    GPT-4o scored 0-100 metric where lower values indicate more misaligned behavior on open-ended evaluation prompts
  • AI alignmentconcept0.811
    Field within which this work has implications for evaluating alignment progress.
  • Alignment auditconcept0.807
    Systematic investigation of a model's alignment-relevant propensities.
  • Mapping Problemconcept0.806
    Bourget's term (closely related to Seth's real problem) for which organisational features are associated with which experiences; the tractable question this framework pursues.
  • Measure of similarity between the similarity structures (kernels) induced by two different representations
  • Alignment Typeconcept0.797
    The only statistically significant predictor of koan battery scores (p=0.006); includes Constitutional AI, RLHF, SFT, roleplay, empathy