framework
active
framework:contrastive-learningContrastive learning
Supervised learning framework where system learns by observing contrast between current response and nudged improved response; requires weak additional forces from supervisor
Neighborhood — ranked by edge-count
Papers (2)
paper
Methods (4)
method
- Binary NCE LossimplementsOne of two contrastive objectives analyzed; shown to be minimized by PMI kernel representation
- InfoNCE LossimplementsOne of two contrastive objectives analyzed; shown to be minimized by PMI kernel representation up to scaling
- SimCSEimplementsContrastive sentence embedding method used in color cooccurrence experiment; represents contrastive language learner
- SimCLRimplementsSelf-supervised contrastive learning method cited as instance of NCE-type objectives that converge to PMI kernel
Concepts (1)
concept
- Pointwise Mutual Information KernelimplementsThe kernel that contrastive learners converge to; similarity equals PMI between observations
Frameworks (2)
framework
- Physical learningassociated_withFramework for solving inverse problems in which physical systems autonomously adapt their parameters in response to stimuli through local learning rules, without requiring computational design or explicit cost functions
- The primary novel framework introduced in the paper for learning facet-level personality control vectors
Hypotheses (1)
hypothesis
- Mathematical formalization of what representation models converge to
Conceptual bridges
2-hop · via this framework's ideasWhere ideas in this framework connect to the rest of the corpus — the same concept, an analogy, or a restatement elsewhere.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Method comparing brain activity in conscious vs. unconscious conditions.
- The property that living structures contain intense contrast—far more than one imagines helpful; true opposites which annihilate each other when superimposed, creating differentiation that gives birth to something; contrast unifies rather than separates when used correctly
- Process of inferring causes of sensory information; unified with value learning as integral aspects of free energy minimization.
- Three-setting ablation (Before Training, Without CL, With CL) to isolate the contribution of contrastive learning
- Sentience criterion; capacity occurs even in gene regulatory networks and non-neural morphogenetic agents.
- Pairs of prompts at different reflection levels used to compute steering vectors.
- Inference of parameters encoding contingencies of the world (e.g., likelihood matrix A) at slower timescale than perception.
- Learning model parameters through curious, uncertainty-reducing behavior; reducing ignorance about contingencies