ColSum Concentration

Primary metric for identifying stages of inference via normalized entropy of column sums of attention matrices

Neighborhood — ranked by edge-count

paper

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Concentration Parametersconcept0.721
Sufficient statistics of Dirichlet priors over likelihood; accumulate as experience is gained; analogous to synaptic efficacy
Compositionalityconcept0.680
Central concept: how meaning of wholes depends on meanings of parts and their structural arrangement; multiple formulations explored (Frege, Schrödinger, Whitehead, LEGO).
Complementmethod0.678
Attribute: an attempt at parity, placing elements side by side as equals, though often failing.
Consciuminstitute0.671
Commercial venture pursuing applied AI consciousness research oriented toward safer AI development
What is compositionality?question0.668
Primary guiding question for the paper; explores multiple formulations and uses of the term.
Incommensurabilityconcept0.665
Kuhn's concept: the inability of ideas from one paradigm to be translated into the terms of another, causing communication breakdowns.
Dependent Arisingconcept0.662
Dropping downmethod0.661
Dynamic condition: a menu-like reveal of subordinate content.