claim

active

claim:covariance-pooling-preserves-joint-activation-structure-feature-co-occurrence-that-mean-pooling-discards

Covariance pooling preserves joint activation structure (feature co-occurrence) that mean pooling discards

Specific interpretive claim about what covariance pooling captures: the pairwise co-activation patterns across features that are invisible to mean pooling.

Source paper

extracted_from

Covariance-based Sequence Pooling

(2026) · Dooms, Thomas · Wang, Nicholas K. · Pearce, Michael T.

Neighborhood — ranked by edge-count

Findings (2)

finding

Covariance pooling achieves +52.9% R² improvement over mean pooling on Genomic Track Prediction.
supports
Primary empirical result demonstrating practical utility of covariance pooling method.
Gene Ontology prediction: +8.4% AUC improvement with unsupervised autoencoder and covariance pooling embeddings
supports
Empirical result: covariance pooling combined with unsupervised autoencoder embeddings improves Gene Ontology prediction AUC by 8.4% over mean pooling.

Communities (3)

community

Manifold-aware concept steering in neural representations
members_of
Explores geometry of activation/behavior manifolds to enable selective, non-destructive concept interventions.
Covariance pooling for high-dimensional genomic embeddings
members_of
Using second-order statistics to compress activation patterns while preserving feature co-occurrence structure, tested on genomic prediction tasks without large labeled datasets.
Covariance pooling for genomic embeddings
members_of
Replaces mean pooling with second-order statistics, achieving large R² and AUC gains on genomic tasks.

Claims (1)

claim

Second moments preserve structure that first moments destroy.
extends
Core interpretive claim generalizing beyond genomics; argues mean pooling discards information present in covariance.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Covariance pooling compresses gigabytes of activations into compact stable embeddings without large labeled datasetsfinding0.827
Practical finding: the method produces compact fixed-length representations from large volumes of token activations without requiring supervised labels.
Covariance pooling could generalize beyond genomics as a general-purpose replacement for mean poolingclaim0.824
Authors' suggestion that the second-moment preservation principle applies broadly, not just to genomic foundation models.
Covariance Poolingmethod0.820
Novel aggregation technique replacing mean pooling; preserves joint activation structure (feature co-occurrence) in token embeddings.
Can covariance pooling generalize beyond genomics to other domains?question0.790
Open question implied by the claim that the method could generalize; empirical validation beyond genomics is not provided in this paper.
Structure-preserving transformations ensure each unfolding step is coherence-preserving and responds to field state.claim0.745
The discovery of perfect abstract equality representations that cannot be decomposed into entity representations is a foundational result informing our understanding of how symbolic and connectionist architectures coexistclaim0.730
Concluding claim about theoretical significance of the hierarchical equality finding.
Geometry-behavior correlate robust to pooling strategy, distance metric, and frozen encoderfinding0.726
Robustness checks confirm sign stability.
Cooperation between the associative memory primitive and storage management is required for efficient garbage collection, especially as n grows beyond 2.hypothesis0.726