method
active
method:acc-response-level-accuracyACC (Response-level Accuracy)
Prior metric assigning a single accuracy score to an entire response; baseline for comparison
Neighborhood — ranked by edge-count
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Measures the proportion of atomic units whose characteristic scores match the target persona score
- Proportion of characters (out of 26) for which all five Big Five dimensions are predicted correctly
- Criterion requiring that model's description of internal state be accurate, distinguishing genuine introspection from confabulation.
- Requirement that answers to questions be responsive as well as truthful; requires knowing that questioner will know the answer after receiving it.
- Extension of ARR where attention is directed specifically to linguistic spans (complement syntax or mental state verbs) within the stimulus.
- Prior metric measuring consistency via standard deviation of response-level scores; baseline for comparison
- The adaptive, incremental nature of living process, allowing small steps with continuous evaluation and adjustment.
- Time series of response representations contextualized by applying dot-product attention to the corresponding stimulus representations.