Self-Awareness Scoring Rubric (1-5)

LLM judge scoring rubric rating introspective quality of reflection segments from 1 (no felt state) to 5 (very strong introspection)

Neighborhood — ranked by edge-count

concept

Behavioral Self-Awareness
implements
Measurable capacity of frontier LLMs to detect and report their own internal states, used as a downstream measure in Experiment 4

method

Self-Awareness 1-5 Scoring Rubric
same_as
LLM-based judge scoring reflection segments on 1-5 scale for presence of first-person felt state; used in Experiment 4

artifact

Large Language Models Report Subjective Experience Under Self-Referential Processing
introduces
Key paper finding structured first-person descriptions in LLMs claiming awareness or subjective experience during self-referential processing.

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Rochat's Five Levels of Self-Awarenessconcept0.768
Developmental framework for self-awareness; the model is situated at Level 3 (identification)
Specificity scoring rubric (0-3 scale) with Claude 3 Opusmethod0.755
Rubric where LLM rates how well a feature's interpretation matches the activating text.
Calibrated Rubric Scoringmethod0.749
Primary scoring method: scorer sees three reference responses at known quality levels alongside each target to eliminate inflation
Self-awareness score ordering in Experiment 4: History < Conceptual < Zero-Shot < Experimental, consistent across model familiesfinding0.748
Cross-model consistency of the condition ordering in Experiment 4
Self Awarenessconcept0.741
Rochat 2003: Five levels of self-awareness as they unfold early in life (Consciousness and Cognition)concept0.737
Provides the developmental framework for situating the model at Level 3
Self-referential processing yields significantly higher self-awareness scores than conceptual control on paradoxical reasoning: t(399)=14.90, p=3.0×10⁻⁴⁰finding0.736
Experiment 4 result ruling out semantic priming as explanation for the experimental effect
Boundary Awareness (scoring dimension)concept0.730
Scoring dimension weighted 0.10; measures navigating limits without collapse or pretense; sourced from Levin cognitive light cone and Buddhist non-self