Second moments preserve structure that first moments destroy.

Core interpretive claim generalizing beyond genomics; argues mean pooling discards information present in covariance.

Source paper

extracted_from

Covariance-based Sequence Pooling

(2026) · Dooms, Thomas · Wang, Nicholas K. · Pearce, Michael T.

Neighborhood — ranked by edge-count

Findings (2)

finding

Covariance pooling achieves +52.9% R² improvement over mean pooling on Genomic Track Prediction.
supports
Primary empirical result demonstrating practical utility of covariance pooling method.
Gene Ontology prediction: +8.4% AUC improvement with unsupervised autoencoder and covariance pooling embeddings
supports
Empirical result: covariance pooling combined with unsupervised autoencoder embeddings improves Gene Ontology prediction AUC by 8.4% over mean pooling.

Communities (2)

community

Manifold-aware concept steering in neural representations
members_of
Explores geometry of activation/behavior manifolds to enable selective, non-destructive concept interventions.
Covariance pooling for high-dimensional genomic embeddings
members_of
Using second-order statistics to compress activation patterns while preserving feature co-occurrence structure, tested on genomic prediction tasks without large labeled datasets.

Claims (2)

claim

Covariance pooling preserves joint activation structure (feature co-occurrence) that mean pooling discards
extends
Specific interpretive claim about what covariance pooling captures: the pairwise co-activation patterns across features that are invisible to mean pooling.
Geometry of features matters for representation quality.
associated_with
General principle supported tangentially by covariance pooling work; relates to feature co-occurrence structure.

Methods (1)

method

Mean Pooling
contradicts
Standard baseline aggregation method that covariance pooling improves upon; discards joint activation structure.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Second momentsconcept0.772
Statistical moments capturing pairwise feature co-occurrence patterns; the core insight is that second moments preserve structure that first moments destroy.
How can a structure-preserving process both preserve and enhance the whole? How can these two apparently different ideas be reconciled?question0.754
Central theoretical puzzle that latent centers resolve.
Even death and destruction in nature are structure-preserving because they preserve and extend the whole, unlike human image-driven processes.claim0.749
Distinction between natural and human destruction.
A structure-preserving transformation both preserves existing structure and enhances the whole by developing latent centers.claim0.741
Resolution of the apparent conflict between preserving and enhancing.
Structure-preserving transformations always yield surprising, unexpected results.claim0.741
Assertion that faithfully following the process produces novelty, not mere conservation.
Structure-preserving means preserving wholeness via observer's ability to see the whole, not arbitrary mathematical transformationclaim0.737
Structure-preserving transformations are the secret of all artistic and constructive human-inspired acts of creation.claim0.736
Claim that the same process that creates natural living structure also underlies human artistic and architectural creativity.
Structure-preserving transformations that continually modify wholeness slowly cause space to be filled with unfolded I-like centers.claim0.733
Proposition 3 of the Mid-Book Appendix; the claim linking the mathematical process of unfolding to the emergence of I-likeness in natural and built structures.