method
active
method:rc-response-level-retest-consistencyRC (Response-level Retest Consistency)
Prior metric measuring consistency via standard deviation of response-level scores; baseline for comparison
Neighborhood — ranked by edge-count
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Measures reproducibility of persona alignment across repeated generations using Earth Mover's Distance
- Reproducibility of persona alignment across repeated generations for the same prompt
- Machine learning paradigm where agents learn to maximize cumulative reward through interaction.
- Prior metric assigning a single accuracy score to an entire response; baseline for comparison
- Alternative framework for agent behavior; based on reward maximization rather than free energy minimization.
- Requirement that answers to questions be responsive as well as truthful; requires knowing that questioner will know the answer after receiving it.
- Illustrates how even simple AI properties can be informative as sensitive negative-direction indicators
- Metric measuring within-persona stability of MFQ responses; formalizes model consistency when simulating a given character