method
active
method:exact-match-accuracy-with-flexible-number-extraction

Exact-Match Accuracy with Flexible Number Extraction

Evaluation metric: proportion of samples with predicted answer exactly matching ground-truth, with flexible number extraction.

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Proportion of characters (out of 26) for which all five Big Five dimensions are predicted correctly
  • Proportion of aligned interchange interventions with equivalent high-level and low-level effects; graded measure of causal abstraction.
  • Used in the appendix to check whether striking phrases from the Xeno Sutra exist on the internet.
  • Accuracy Criterionconcept0.732
    Criterion requiring that model's description of internal state be accurate, distinguishing genuine introspection from confabulation.
  • Metric of how well models reconstruct information from hidden states; Sauers' study found showing janus thread extends distribution tails.
  • Evaluation metric measuring how well a trained intervention matches desired counterfactual model behavior
  • The perceptual capacity to grasp the structure of wholeness directly, without interposing categories; very difficult to learn but essential for structure‑preserving making.
  • Tuple retrieval by matching against a template, similar to relational database queries.