finding
active
finding:high-projection-difference-samples-continue-to-induce-stronger-trait-expression-than-random-samples-even-after-llm-based-filtering-removes-overtly-trait-expressing-samplesHigh projection difference samples continue to induce stronger trait expression than random samples even after LLM-based filtering removes overtly trait-expressing samples
Shows persona vector filtering has complementary strengths to LLM judges, surfacing non-obvious problematic samples
Source paper
extracted_from(2025) · Chen, Runjin · Arditi, Andy · Sleight, Henry · Evans, Owain +1
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Shows persona vector screening captures a non-conventional notion of hallucination complementary to LLM judges
- Methodological concern raised about potential bias and circularity of model-based classifiers
- Justifies the use of projection difference metric rather than simpler raw projection for data screening
- Enables pre-finetuning data screening; Figure 8 shows strong dataset-level correlations across all three traits
- Author's interpretive explanation for why projection difference outperforms raw projection in data screening
- Central interpretive claim of the paper supported by multiple convergent analyses
- Establishes that the observed linear structure is not merely a representation of text probability
- Is there a tradeoff between subtlety of trait expression and robustness in character-trained models?question0.764Open question raised in Appendix E regarding misaligned persona behavior