question
active
question:do-findings-from-multiple-choice-question-or-short-form-evaluation-of-persona-fidelity-generalize-to-open-ended-generation-tasksDo findings from multiple-choice question or short-form evaluation of persona fidelity generalize to open-ended generation tasks?
Research gap motivating the paper's focus on generation-based evaluation
Source paper
extracted_from(2025) · Jisu Shin · Juhyun Oh · Eunsu Kim · Hoyun Song +1
Neighborhood — ranked by edge-count
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Identifies the key theoretical vulnerability of the model-persona view
- Contradicts prior concern that longer generations cause coherence degradation
- Supported by GPT-4o achieving highest ACCatom in Questionnaire vs Essay and SMP tasks
- Second of three hypotheses about persona implementation, supported by PCA evidence from Lu et al.
- Evidence that core representations like preferences are persona-relative, supporting claim that personas gate content of representations
- Additional evidence that core representations are persona-relative, supporting Claim about persona-relative representations
- The model is able to express many subforms of a persona, with different elicitation methods eliciting different manifestationshypothesis0.754PSM-derived hypothesis supported by discourse-type facet analysis
- Open question proposed by authors for future work on the dimensionality and structure of persona space