Long-form Text Coherence in LLMs

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• long-range coherenceconcept0.810
  Ability to maintain structural consistency over extended sequences
• Long-range coherence in sequencesconcept0.767
  Ability to maintain organized behavior over extended scales; shown limited in flat autoregressive models, enabled in hierarchical/biological systems.
• Logical Coherence of LM Beliefsconcept0.765
  The extent to which an LM's beliefs respect logical entailment: if it believes A and A→B, it should also believe B.
• Overall human-LLM judge agreement rate for coherency is 91.7% across 120 pairwise judgmentsfinding0.744
  Validates the LLM-as-a-Judge evaluation protocol for coherency scoring
• Large Language Models (LLMs)concept0.741
  Transformer-based models like GPT-4, LaMDA, PaLM; assessed for GWT indicators.
• Reflection in LLMsconcept0.739
  The core phenomenon studied: the ability of LLMs to evaluate and revise their own reasoning.
• Do LLMs have a unified representation of truth that spans structurally and topically diverse data?question0.739
  Central research question driving dataset design and experimental approach
• The better an LLM is at language modeling, the more it aligns with vision models, and vice versa — linear relationship between language modeling score and vision-language alignmentfinding0.739
  Core cross-modal empirical result: larger and better language models align better with vision models