concept
active
concept:latent-pattern-repository-pprior

latent pattern repository (Pprior)

Unlabeled statistical regularities stored during pretraining.

Neighborhood — ranked by edge-count

Claims (1)

claim

Concepts (3)

concept
  • semantic anchoring
    associated_with
    The central idea that external structure binds latent patterns to desired targets.
  • Induction Heads
    supports
    Mechanistic circuits in transformers documented by Olsson et al. 2022, cited as evidence for pattern-repository assumption
  • Superposition of Sparse Features
    supports
    Mechanistic finding by Bricken et al. 2023 about how LLMs store features; cited as operational justification for pattern-repository assumption

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • latent patternsconcept0.762
    Statistical regularities stored in pretrained models.
  • prior knowledge Ppriorconcept0.757
    The model's unlabeled, behavior-agnostic repository of regularities.
  • Pattern-repository assumptionconcept0.736
    Assumption that pretraining populates a repository of unlabeled latent patterns Pprior.
  • Pr(Ai)2R Groupinstitute0.704
    Affiliation of Atticus Geiger
  • latent reasoningconcept0.703
    Reasoning approach using learnable hidden embeddings.
  • Reinforcement Learning with PPOmethod0.699
    Actually training Claude to comply with the conflicting objective using Proximal Policy Optimization
  • Pattern Regulationconcept0.690
    Active maintenance and restoration of correct anatomical pattern; central to morphogenesis and regeneration.
  • Latent Stitchmethod0.687
    Baseline method using a single orthogonal matrix trained to map source latents to target latents via CL auxiliary loss without behavioral objective.