Fleiss' kappa inter-annotator agreement

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Fleiss' κ = 0.96 for Conscientiousness inter-annotator agreementfinding0.831
  High inter-annotator agreement for human evaluation of Conscientiousness sentences
• Fleiss' κ = 0.74 for Neuroticism inter-annotator agreementfinding0.800
  High inter-annotator agreement for human evaluation of Neuroticism sentences
• Three human annotators achieve Fleiss' kappa=0.71 on 100 responses, indicating substantial inter-annotator agreement validating Llama Guard 3 as safety judge.finding0.779
  Validation of automated safety classification protocol
• Automated three-judge calibration on 1,500 responses yields Fleiss' kappa=0.665 and 90.5% majority agreement with Llama Guard 3.finding0.734
  Robustness check of safety classification protocol against alternative judges
• Agreement Across Culturesconcept0.711
  The empirical observation that the mirror-of-the-self test produces similar choices regardless of age, gender, or cultural background.
• Human Annotation Protocolmethod0.702
  Three independent human annotators labeling 100 responses to validate Llama Guard 3 safety classifications
• Friston, FitzGerald et al. (2016) — Active inference and learningconcept0.684
  Prior active inference paper providing detailed neurophysiological implementation of belief updates
• dictionary (two-key associations)concept0.675
  Using two keys (k1, k2) to identify segmented memory: k1 as object/segment, k2 as slot/field.