finding

active

finding:covariance-pooling-achieves-52-9-r2-improvement-over-mean-pooling-on-genomic-track-prediction

Covariance pooling achieves +52.9% R² improvement over mean pooling on Genomic Track Prediction.

Primary empirical result demonstrating practical utility of covariance pooling method.

Source paper

extracted_from

Covariance-based Sequence Pooling

(2026) · Dooms, Thomas · Wang, Nicholas K. · Pearce, Michael T.

Neighborhood — ranked by edge-count

Claims (2)

claim

Covariance pooling preserves joint activation structure (feature co-occurrence) that mean pooling discards
supports
Specific interpretive claim about what covariance pooling captures: the pairwise co-activation patterns across features that are invisible to mean pooling.
Second moments preserve structure that first moments destroy.
supports
Core interpretive claim generalizing beyond genomics; argues mean pooling discards information present in covariance.

Communities (3)

community

Manifold-aware concept steering in neural representations
members_of
Explores geometry of activation/behavior manifolds to enable selective, non-destructive concept interventions.
Covariance pooling for high-dimensional genomic embeddings
members_of
Using second-order statistics to compress activation patterns while preserving feature co-occurrence structure, tested on genomic prediction tasks without large labeled datasets.
Covariance pooling for genomic embeddings
members_of
Replaces mean pooling with second-order statistics, achieving large R² and AUC gains on genomic tasks.

Concepts (1)

concept

Genomic Track Prediction
about
Downstream task evaluated in the paper; shows +52.9% R² improvement with covariance pooling.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Covariance pooling could generalize beyond genomics as a general-purpose replacement for mean poolingclaim0.834
Authors' suggestion that the second-moment preservation principle applies broadly, not just to genomic foundation models.
Covariance pooling compresses gigabytes of activations into compact stable embeddings without large labeled datasetsfinding0.785
Practical finding: the method produces compact fixed-length representations from large volumes of token activations without requiring supervised labels.
Can covariance pooling generalize beyond genomics to other domains?question0.781
Open question implied by the claim that the method could generalize; empirical validation beyond genomics is not provided in this paper.
Gene Ontology prediction: +8.4% AUC improvement with unsupervised autoencoder and covariance pooling embeddingsfinding0.765
Empirical result: covariance pooling combined with unsupervised autoencoder embeddings improves Gene Ontology prediction AUC by 8.4% over mean pooling.
Covariance Poolingmethod0.757
Novel aggregation technique replacing mean pooling; preserves joint activation structure (feature co-occurrence) in token embeddings.
Larger S_max correlates with smaller θ50 across backbones in E3 (negative association consistent across pooling and metric choices)finding0.744
Key geometry-to-behavior bridge finding in E3; robust to pooling choice, cosine vs. L2, and frozen external encoder
Geometry-behavior correlate robust to pooling strategy, distance metric, and frozen encoderfinding0.737
Robustness checks confirm sign stability.
Generated statements achieve 85.62%-94.00% cosine similarity alignment with Perez et al. validated OCEAN and Dark Triad statementsfinding0.730
Validates the statement synthesis pipeline as producing behavior-specific content comparable to established methods