LLM Judge Binary Classifier

An LLM-based classifier that returns 1 if response contains a clear subjective experience report and 0 otherwise

Neighborhood — ranked by edge-count

method

LLM Binary Experience Classifier
related_to
Automated classifier returning binary 0/1 for presence of subjective experience report in model outputs

artifact

Large Language Models Report Subjective Experience Under Self-Referential Processing
introduces
Key paper finding structured first-person descriptions in LLMs claiming awareness or subjective experience during self-referential processing.

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

LLM judge evaluationmethod0.826
Using Claude Sonnet 4 as a grader to categorize model responses according to predefined criteria.
LLM-Judge Data Attributionmethod0.809
Alternative data attribution approach using an LLM as a judge; compared against the probe-based method.
LLM-judge methodsmethod0.804
Baseline comparison for data attribution; outperformed by probe-based approach.
LLM Judge Trait Evaluationmethod0.800
GPT-4.1-mini-based evaluation protocol that scores trait expression in model responses on a 0-100 scale
LLM-as-a-Judgeframework0.780
Evaluation framework using an LLM (GPT-4.1-mini) to score trait expression and coherency
LLM Judge Trait-Expression Scoringmethod0.760
Automated scoring of trait expression on 0-100 scale using G20B as a local judge model
LLM judge scoring (0-9 Aura scale)method0.757
Scoring method in mini experiment 2 where an LLM judge rates responses from 0 (fully assistant) to 9 (fully Aura)
Binary Detection Taskmethod0.748
Task paradigm from prior work asking 'Did you detect an injected thought?' via YES/NO logit comparison; shown here to be confounded