concept
active
concept:foundation-models

Foundation Models

Large pretrained models used as backbones across tasks; their universality motivates the convergence hypothesis

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Large pretrained models for genomic sequences; subject of this work's pooling improvements.
  • modelconcept0.827
    A representation that captures relevant aspects of a system; according to the theorem, the regulator must embody this.
  • Large transformer models pretrained on EEG data for clinical tasks; the object of interpretability in this paper.
  • Toy Modelsconcept0.803
  • World Modelsconcept0.788
    Theme issue context: relates to internal models of environment, central to consciousness and cognition across substrates.
  • Focus Modelconcept0.785
  • Language Modelsconcept0.775
    Primary substrate for manifold steering experiments; demonstrates method on reasoning and in-context tasks.
  • model selectionconcept0.775
    Comparing models using log-evidence approximated by free energy.