method
active
method:interview-with-questionnaires-taskInterview with Questionnaires Task
Task converting IPIP-BFFM multiple-choice items into open-ended interview questions for persona fidelity evaluation
Neighborhood — ranked by edge-count
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- One of four ToM tasks analyzed; requires inferring speaker intent from indirect hints; scored 0/1.
- Novel task asking which of 10 sentences received injection, cycling injection through all positions to average out positional bias
- The paper identifies task difficulty as a key moderator: easy MMLU questions show performative CoT, hard GPQA-Diamond questions show genuine reasoning
- Task providing scenario prompts for LLMs to write essays reflecting personality traits
- An Elephant action of answering a query.
- Novel task asking which of two sentences received a stronger injection, using matched-pairs design to control for positional bias
- Task prompting LLMs to generate free-form social media posts reflecting assigned personality personas
- Dot product between hidden state and concept vector averaged across 5-layer window around best layer; measures model's internal emotive state