Semantic Diversity

Core concept measured by NLI Diversity — diversity of meaning across a set of dialogue responses

Neighborhood — ranked by edge-count

paper

concept

Lexical Diversity
related_to
Contrasted with semantic diversity; measured by n-gram overlap and distinct-n

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Semantic Diversity Scoremethod0.872
Diversity metric computed as 1 minus mean pairwise cosine similarity of response embeddings, using OpenAI's text-embedding-3-small
semantic valueconcept0.796
Meaning that arises from relations within the graphical system, not inherent in elements.
semantic structureconcept0.777
The meaningful organization of concepts in a model's representation space, claimed to be better captured by manifolds than by SAEs.
Output Diversityconcept0.767
The breadth of distinct outputs an LLM can produce, which is reduced by mode collapse after alignment training
Semantic Deduplicationmethod0.764
Greedy pass retaining texts only if cosine similarity below 0.9 with all retained texts; used to maintain diverse statement and SJT corpora
Confidence NLI Diversity achieves state-of-the-art performance on measuring semantic diversityclaim0.763
Main performance claim of the paper
Semantic Denotationconcept0.760
Central mechanism in denotational design: precise mathematical meaning assigned to types and expressions, independent of implementation.
Diversity Parameterconcept0.751
Gold standard value (e.g., nucleus sampling p-value) used as ground truth for evaluating diversity metrics