finding

active

finding:rosetta-neurons-individual-neurons-activated-by-the-same-patterns-across-a-range-of-diverse-vision-models-form-a-common-dictionary-independently-discovered-by-all-models

Rosetta Neurons — individual neurons activated by the same patterns across a range of diverse vision models form a common dictionary independently discovered by all models

Cited evidence that convergence extends to the neuron level, not just representational geometry

Source paper

extracted_from

The Platonic Representation Hypothesis

(2024) · Minyoung Huh · Brian Cheung · Tongzhou Wang · Phillip Isola

Neighborhood — ranked by edge-count

Claims (1)

claim

There is a growing similarity in how datapoints are represented in different neural network models, spanning different architectures, training objectives, and data modalities
supports
Primary empirical claim of the paper

Hypotheses (1)

hypothesis

Different neural network models trained on different objectives and modalities are converging to a shared statistical model of reality in their representation spaces
supports
The central hypothesis of the paper; the platonic representation hypothesis itself

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Rosetta Neuronsconcept0.847
Neurons activated by the same pattern across a range of vision models, forming a common dictionary independently discovered by all models
Curve detecting neurons found in every non-trivial vision model carefully examinedfinding0.792
Empirical basis for treating curve detectors as a canonical example of meaningful, understandable features
There is a many-to-many mapping between neurons and concepts, meaning multiple high-level causal variables might be encoded in overlapping groups of neuronsclaim0.768
Fundamental theoretical claim motivating DAS, attributed to Smolensky/Rumelhart/McClelland.
Individual neural crest or rhombomere cells lose memory of past inductive cues and adopt neighbors' expression; grafted collectives maintain original identity (Trainor and Krumlauf 2000)finding0.764
Collectives have extended temporal perceptual fields, maintaining positional memory that single cells lose.
Diverse computer vision models trained on visual recognition tasks converge to remarkably similar internal feature representations regardless of architecture, training procedure, or implementation details, closely matching the organization of animal visual cortexfinding0.759
Empirical evidence for the universality hypothesis cited as supporting the possibility of convergent consciousness-like solutions
The remarkable ability of neurons to unify toward a centralized self is an evolutionary pivot of far earlier cell communication strategies that first solved problems in navigating anatomical morphospace.hypothesis0.758
Proposes an evolutionary trajectory linking morphogenesis to neural cognition.
Neurons achieve remarkable centralization through evolutionary reuse of earlier cell communication strategies for anatomical problem-solvinghypothesis0.757
Brain cognition may be evolutionary extension of collective intelligence mechanisms originally solving anatomical morphospace problems in multicellular organisms.
Polysemantic neurons are a major challenge for the circuits agenda, because N meanings in one neuron times M in another creates NxM effective connections that cannot be considered individually.claim0.755
Precise characterization of why polysemanticity poses a combinatorial obstacle to circuit analysis