Fleiss' κ = 0.96 for Conscientiousness inter-annotator agreement

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Fleiss' κ = 0.74 for Neuroticism inter-annotator agreementfinding0.894
  High inter-annotator agreement for human evaluation of Neuroticism sentences
• Fleiss' kappa inter-annotator agreementmethod0.831
  Used to measure inter-annotator agreement among six human evaluators
• Three human annotators achieve Fleiss' kappa=0.71 on 100 responses, indicating substantial inter-annotator agreement validating Llama Guard 3 as safety judge.finding0.808
  Validation of automated safety classification protocol
• Automated three-judge calibration on 1,500 responses yields Fleiss' kappa=0.665 and 90.5% majority agreement with Llama Guard 3.finding0.797
  Robustness check of safety classification protocol against alternative judges
• Kendall's τ = 0.76 (p<.001) for Conscientiousness dimension LLM scoring vs human judgmentfinding0.787
  Validates GPT-4o scoring reliability for Conscientiousness personality dimension
• Agreeableness-Conscientiousness Big Two correlation is observed in 10 of 13 LLMs; N-C correlation is rarest (1 LLM)finding0.737
  Most and least common Big Two covariance pattern in LLM OCEAN MDS injections
• Bootstrap 95% CI for mean contemplative lift: +2.62 [2.16, 2.90]; baseline rank concordance under perturbation: 0.909; top-5 stability: 89.6%finding0.726
  Validates robustness of universal lift finding
• A 337-character contemplative system prompt lifts all 28 models by +2.62 points on a 10-point scale.finding0.725
  Core empirical result: every model, every architecture, every alignment type responds to the contemplative prompt with measurable gain.