method
active
method:bits-per-byte-language-modeling-score

Bits-Per-Byte Language Modeling Score

Language model performance metric used in cross-modal alignment experiments to rank LLM competence

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Normalized cross-entropy metric used as language model performance measure on OpenWebText
  • Average of three LLM-graded binary judgments.
  • Features related to gender, racial, ethnic biases, slurs, and hate speech.
  • Claude 4.5 Haiku used to segment responses into attempts and score each attempt 0-100 for relevance
  • Language Modelsconcept0.717
    Primary substrate for manifold steering experiments; demonstrates method on reasoning and in-context tasks.
  • Language Modelconcept0.716
    Primary test domain for manifold steering, including reasoning and ICL tasks
  • Prefix scoremethod0.715
    Prior metric on synthetic repeated random strings; induction score analogous.
  • Philosophical stance that LM psychological traits should be evaluated purely in terms of input-output behaviour.