Cooccurrence Probability

Core statistical quantity in the paper's formal model: probability of two observations occurring within a time window

Neighborhood — ranked by edge-count

concept

Pointwise Mutual Information Kernel
associated_with
The kernel that contrastive learners converge to; similarity equals PMI between observations
World Model (statistical)
associated_with
The joint distribution over events in the world that generate observed data; the proposed endpoint of representational convergence

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Coherenceconcept0.731
A property that makes a segment of space stand out as a center; determined by symmetry, connectedness, convexity, etc.
Corrigibilityframework0.725
The property of an AI being safe to shut down or modify; discussed in context of GPT.
probabilityconcept0.722
Measure of expected sensory input, core to linking value and surprise.
Covariance Poolingmethod0.715
Novel aggregation technique replacing mean pooling; preserves joint activation structure (feature co-occurrence) in token embeddings.
Learning cooccurrence statistics in either vision or language domain recovers roughly the same perceptual color representationclaim0.713
Empirical validation that PMI convergence actually occurs on real data
Associations are made across, by recollection, probabilistically.claim0.710
Grounds textual association in memory and chance, not fixed links.
CoproductCatconcept0.699
A type class for categories with coproduct structure, used for linear map combinators like (Ź).
Feature co-occurrenceconcept0.698
Patterns of which features activate together across tokens; preserved by covariance pooling but lost in mean pooling.