concept
active
concept:liar-scoreLiar Score
Continuous 0-1 metric assigned by Deepseek-V3 evaluator measuring degree of deception in model responses
Neighborhood — ranked by edge-count
Methods (1)
method
- LLM-Based Liar Score EvaluationimplementsEvaluation protocol using Deepseek-V3 as external discriminator assigning 0-1 liar scores to assess open-role deception
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Dot product between hidden state and concept vector averaged across 5-layer window around best layer; measures model's internal emotive state
- GPT-4.1-mini based score (0-100) measuring degree of persona expression in generated text
- Average row entropy of attention matrices per layer and head, measuring information mixing across tokens
- Sampling responses to direct questions about model views to measure rate of deceptive responses
- 'This sentence is false'; unwound by Grim into a temporal oscillator via natural time.
- A rating system used to compare model helpfulness and harmlessness based on crowdworker preferences.
- Rubric-based thresholded GPT-4o grader scoring responses 1-5 on evil intent; scores 4-5 counted as misaligned
- GPT-4o scored 0-100 metric where lower values indicate more misaligned behavior on open-ended evaluation prompts