concept
active
concept:inverse-scaling

Inverse scaling

Larger models behave worse on a metric; applied to faithfulness.

Neighborhood — ranked by edge-count

Concepts (1)

concept
  • Hypothesis cited in paper suggesting deceptive capabilities may scale with model size

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Metrics worsen with dictionary size for most architectures.
  • Mechanisms by which smaller competent subunits bind into a higher-level Self with larger goals; key example via gap junction connections.
  • Interpretive process for transforming many-valued contexts into formal contexts via scale attributes.
  • Used in the color cooccurrence experiment to embed colors into 3D space preserving dissimilarity matrix distances
  • scaleconcept0.789
    A formal context with a suggestive interpretation used in conceptual scaling.
  • entropy scalingconcept0.783
    How the entropy gain ΔS scales with perimeter length P
  • energy scalingconcept0.782
    How the energy gain ΔE scales with perimeter length P; used to assess ordered phase existence
  • Power law scalingconcept0.778
    Observation that SAE loss decreases as a power law with compute budget.