method
active
method:multi-turn-rate-mtrMulti-Turn Rate (MTR)
Metric evaluating whether the RPA maintains persona across turns, penalizing repetition, out-of-character responses, and dialogue errors
Neighborhood — ranked by edge-count
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Secondary metric: percentage of responses containing multiple attempts, separating surface from actual self-correction
- A prompting baseline that elicits N responses across N sequential conversation turns
- Primary metric: percentage of responses containing multiple attempts that successfully improve on the first attempt
- Key evaluation metric: proportion of inputs for which an intervention successfully flips model output
- Intuition for why averaging yields high-level features.
- Turn-level attribution graphs give compact, interpretable explanations of multi-turn model behaviorclaim0.688Case study conclusion.
- n-dimensional association model can express binding mechanisms for multimethods by letting values range over methods of arity n and applying appropriate α and β transformations.