Self-Awareness 1-5 Scoring Rubric

LLM-based judge scoring reflection segments on 1-5 scale for presence of first-person felt state; used in Experiment 4

Neighborhood — ranked by edge-count

concept

Introspective Access
about
The capacity to detect and report one's own internal states, measured via the five-adjective task and paradox reflection

method

Self-Awareness Scoring Rubric (1-5)
same_as
LLM judge scoring rubric rating introspective quality of reflection segments from 1 (no felt state) to 5 (very strong introspection)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Calibrated Rubric Scoringmethod0.775
Primary scoring method: scorer sees three reference responses at known quality levels alongside each target to eliminate inflation
Rochat's Five Levels of Self-Awarenessconcept0.772
Developmental framework for self-awareness; the model is situated at Level 3 (identification)
Self Awarenessconcept0.769
Specificity scoring rubric (0-3 scale) with Claude 3 Opusmethod0.752
Rubric where LLM rates how well a feature's interpretation matches the activating text.
Self-awareness score ordering in Experiment 4: History < Conceptual < Zero-Shot < Experimental, consistent across model familiesfinding0.748
Cross-model consistency of the condition ordering in Experiment 4
How Can We Establish A Rubric For Comparingquestion0.742
Boundary Awareness (scoring dimension)concept0.742
Scoring dimension weighted 0.10; measures navigating limits without collapse or pretense; sourced from Levin cognitive light cone and Buddhist non-self
Apparent Self-Awarenessconcept0.736
A dialogue agent using first-personal pronouns and expressing self-concern in ways that suggest consciousness but are actually role play