method
active
method:acc-response-level-accuracy

ACC (Response-level Accuracy)

Prior metric assigning a single accuracy score to an entire response; baseline for comparison

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Measures the proportion of atomic units whose characteristic scores match the target persona score
  • Proportion of characters (out of 26) for which all five Big Five dimensions are predicted correctly
  • Accuracy Criterionconcept0.749
    Criterion requiring that model's description of internal state be accurate, distinguishing genuine introspection from confabulation.
  • Responsivenessconcept0.747
    Requirement that answers to questions be responsive as well as truthful; requires knowing that questioner will know the answer after receiving it.
  • Extension of ARR where attention is directed specifically to linguistic spans (complement syntax or mental state verbs) within the stimulus.
  • Prior metric measuring consistency via standard deviation of response-level scores; baseline for comparison
  • The adaptive, incremental nature of living process, allowing small steps with continuous evaluation and adjustment.
  • Time series of response representations contextualized by applying dot-product attention to the corresponding stimulus representations.