method
active
method:human-annotation-protocolHuman Annotation Protocol
Three independent human annotators labeling 100 responses to validate Llama Guard 3 safety classifications
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Annotators score diversity of response sets 1-5 with half-point increments; used as ground truth correlation target
- Used to measure inter-annotator agreement among six human evaluators
- Central mechanism in denotational design: precise mathematical meaning assigned to types and expressions, independent of implementation.
- Defines the core concept of the paper.
- GPT-4o used to annotate persona generation outputs for presence of Baumeister and ELEPHANT subfacets
- Intelligences distinct from human minds, including AI and artificial life agents.
- Formal modeling approach used throughout Fruit to provide mathematical meaning to GUI abstractions; enables reasoning about program properties.
- Proposed mechanisms for verifying the provenance of creative content — critiqued as raising the wrong question (what made it vs. does it elevate us)