concept
active
concept:sequence-poolingSequence pooling
General technique for aggregating variable-length token embedding sequences into fixed-length representations; mean pooling and covariance pooling are instances.
Neighborhood — ranked by edge-count
Papers (1)
paper
Methods (1)
method
- Mean PoolingextendsStandard baseline aggregation method that covariance pooling improves upon; discards joint activation structure.
Artifacts (1)
artifact
- Goodfire research post introducing covariance pooling as a replacement for mean pooling in genomic foundation models; shows +52.9% R² lift on genomic track prediction.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- A shared repository (the Internet) where morphogenetic sequences are stored, exchanged, mutated, and improved by the public.
- The interdependence of morphogenetic sequences, where each triggers others to repair the whole environment, analogous to arithmetic operations.
- A morphogenetic sequence for direct architect management of tilework, incorporating the fifteen transformations into design and laying steps.
- Novel aggregation technique replacing mean pooling; preserves joint activation structure (feature co-occurrence) in token embeddings.
- An ordering of patterns and transformations that, when followed, can conjure up a whole geometric world
- A step-by-step sequence (posted on patternlanguage.com) for generating ornament from large centers to fine detail while preserving the whole.
- The color property that colors are arranged in a spatial sequence of interacting pairs (like a chain of arrows), creating a gradient that points to and intensifies the main center.
- A general technique of using ordered questions to guide the design unfolding, ensuring a coherent whole emerges from the client's own visions.