Human Evaluation via Sentence Pair Ranking

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Paired Comparison Methodmethod0.732
  Experimental protocol asking observers to compare two systems A and B for degree of life; used to establish objectivity through inter-observer convergence
• Blind Rankingmethod0.731
  Scoring method where responses are anonymized and shuffled; tests whether scorer rankings are real across five independent scorers
• Probe-based ranking outperforms gradient-based and LLM-judge methods at lower costclaim0.723
  Authors' claim that their approach is both more effective in reduction and cheaper than prior methods.
• Pair Comparison / Which-is-more-like-my-eternal-self Testmethod0.722
  The iterative method Alexander uses to make design decisions: compare two versions and ask which is more a picture of one's own eternal self, repeating until convergence.
• Pair Typeframework0.722
  Indexable container with denotation as Bool → a; example demonstrating derivation of API instances from semantic denotation.
• Paired Comparison for Degree of Lifemethod0.721
  Experimental method where subjects choose which of two items has more life, yielding agreement and a relative measure of life.
• Contrast Pairsconcept0.717
  Pairs of statements with opposite truth values used as input to CCS; e.g., cities and neg_cities paired statements
• Pairwise Steering Evaluationmethod0.715
  Named procedure for simultaneously injecting two persona vectors and measuring joint trait-expression outcomes