Google search for exact phrase matching to assess originality

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Exact-Match Accuracy with Flexible Number Extractionmethod0.738
  Evaluation metric: proportion of samples with predicted answer exactly matching ground-truth, with flexible number extraction.
• Self-correcting search with interpretability feedbackconcept0.720
• The results are more widely applicable; similar results will come from asking people in other cultures to answer analogous questions.claim0.719
  Universalist claim predicting cross-cultural generality.
• Contrast-Consistent Searchmethod0.716
  Unsupervised probing method from Burns et al. 2023 that identifies directions along which contrast pair representations are far apart
• Automated interpretability using LLMs can usefully score feature specificity.claim0.715
  Claude 3 Opus ratings aligned with human judgment of feature descriptions.
• Proving that a program meets accomplishment specifications must be based on assumptions about the world, the information it makes available to the program and the effects of the program's actions as well as on facts about the program itself.claim0.709
  Claim about the nature of accomplishment verification.
• Probes trained under different explicit instruction prompts (ask-correct, ask-t/f, ask-able, ask-arith) are highly aligned with each other in cosine similarity.finding0.708
  Shows the passive vs. active divide is more important than the specific wording of instructions.
• Googleinstitute0.701
  Murray Shanahan's part-time employer and provider of LLM technology.