paper:doi-10-48550-arxiv-2606-25234Structuring Sparsity: Block-Sparse Featurizers Capture Visual Concept Manifolds
TL;DR
Lifting the featurizer's atom from a direction to a block of directions recovers concept manifolds that SAEs shatter, and block sparsity is the MAP-matched prior for a representation that is a sparse Minkowski sum of low-dimensional manifolds. The paper introduces block-sparse featurizers (BSFs) in three variants: Vanilla (top-k blocks by norm, untied encoder), Grassmannian (tied encoder with orthonormal charts), and Group Lasso (block soft-threshold). On a synthetic manifold-superposition toy, all three reach per-block R² of 0.93–0.97 against an oracle of 0.99, while a TopK SAE collapses to 0.53. On DINOv3 ViT-B, a minimum-description-length analysis at the 20% distortion floor shows blocks of dimension 2–4 describe activations in fewer bits than b=1 SAEs at every dictionary width and sparsity, and stable rank saturates near 3 even when b=16 is allowed. In InceptionV1, the curve-detector neurons and SAE atoms are fragments of one curve manifold, whose first three Fourier harmonics carry 89% of variance (59/18/12%) and survive a matched null by factors of 470 and 314. A DINOv3 block tracks sun luminance and shadow across twelve Blender models, and SDXL blocks support manifold steering, as in the pretzel block. The implication is that a featurizer is a hypothesis about the data-generating process, so interpretability should infer what the atoms must be rather than assume them. Blocks are one answer, matched to vision but probably not to language.
What to take away
- 1. On a synthetic additive-manifold toy (M=128 factors, d=128, circles, spheres, tori, Möbius strips, Swiss rolls), all three BSFs reach per-block R² of 0.93–0.97 against an oracle ceiling of 0.99, while a TopK SAE reaches only about 0.53.
- 2. Block sparsity falls out as the MAP estimate under a spike-and-slab block prior (Proposition 1), and the penalty must depend on a block only through its ℓ2 norm because the chart is defined only up to O(b) rotation.
- 3. At a 20% distortion floor (R²≈0.8), the Grassmannian BSF describes DINOv3 ViT-B activations in fewer bits than the b=1 SAE at dictionary widths from 8x to 64x expansion, with the minimum at b between 2 and 4.
- 4. Mean stable rank of per-block codes saturates near 3 even when blocks are allotted up to b=16, so DINOv3 concepts average roughly three dimensions, while Group Lasso utilization collapses to about 0.17 at b=16 versus 0.6–0.66 for the other two.
- 5. A single Grassmannian block with b=16 reconstructs the whole InceptionV1 curve manifold, with Fourier harmonics ω=1,2,3 carrying 59%, 18% and 12% of variance, which explains why some curve neurons wrap at 180° (the ω=2 harmonic).
- 6. A matched null (orientation plus white-in-θ noise of 56% input variance) puts only 0.04% of variance in harmonics k≥2, so the measured 18.3% and 12.0% at k=2 and k=3 exceed it by factors of about 470 and 314.
- 7. Mean per-concept smoothness improves with block size: at k=64 active blocks, DINOv3 concept maps are roughly five times smoother (total variation) at b=4 than at b=1, and best single-class F1 on ImageNet-1k beats the SAE at every sparsity.
- 8. Ranking blocks by co-variation of their contribution with sun azimuth and elevation across twelve Blender models found one luminance block and one cast-shadow block whose norm follows ground-truth luminance at every elevation and across object identities.
- 9. Replacing SMixAE's rectifier with a signed code and block projection lifts its toy R² from 0.71 to 0.85, and decoding MFA's learned subspaces additively lifts it from 0.38 to 0.88, because MFA's mixture assumes exactly one active component (|S|=1) and cannot represent a Minkowski sum.
- 10. Open question: the authors suspect block sparsity will mismatch language and video representations the way SAEs mismatch manifolds, so hierarchical, temporal or compositional geometry may need different atoms, and the predicted richer curvature code in deeper layers (V4-like) is untested.
Peer brief — for seminar discussion
This work argues that a featurizer is a hypothesis about how activations are generated, and that the SAE hypothesis of one direction per concept is mismatched to manifold-structured representations. Starting from the additive mixture of manifolds model of Bhalla et al. (activations as a Minkowski sum of low-dimensional manifolds), the authors show that block sparsity is the MAP-matched prior (Proposition 1, spike-and-slab on blocks). They build block-sparse featurizers (BSFs) in three variants: Vanilla top-k, Grassmannian with tied orthonormal charts, and Group Lasso with a block soft-threshold. The alternative route they could have taken is a manifold-learning or sparse-subspace-clustering method such as Isomap or SSC, which they dismiss in the appendix because those methods assume a single manifold or subspace per point. Their MAP result also implies that a Laplace slab gives the group-lasso penalty exactly. The load-bearing evidence is threefold. On a synthetic toy with 128 factors in d=128, BSFs reach per-block R² of 0.93–0.97 versus 0.53 for a TopK SAE and an oracle of 0.99. On DINOv3 ViT-B, a minimum-description-length criterion (needed because reconstruction rises monotonically with every structural parameter) favors blocks of dimension 2–4 over b=1 at every width, and stable rank saturates near 3. In InceptionV1, one block holds the entire curve manifold, with Fourier harmonics carrying 59/18/12% of variance and surviving a matched null. Further demonstrations include a luminance block and a shadow block tracked against Blender ground truth, and SDXL manifold steering via a Kohonen map. The implication is that SAE feature splitting and tiling, such as per-orientation curve atoms, is a predictable artifact of a mismatched prior rather than a property of the network. It also suggests that reading the block coordinate keeps information that complex-cell-style pooling discards. A critical reader would push on several points. The MDL comparison depends on the chosen distortion floor, a Gaussian rate approximation, and shallow minima on a coarse grid, which the appendix concedes; only the direction of the effect is robust. The toy is generated from the very model the prior is derived from, so its recovery is partly circular, and the SMixAE and MFA repairs are tuned post hoc. The subspace assumption (each factor spans a linear b-dimensional space) is stronger than low intrinsic dimension. Steering and the pretzel and cabbage manifolds are qualitative, with no quantitative comparison to SAE steering. Finally, the claim that a block carries one concept is partly an interpretive choice, since stable rank is below the allotted dimension and Group Lasso utilization collapses to 0.17 at b=16. The paper's forward hypothesis is that deeper layers will show richer contour codes, and that language and video will need other atoms.
Methods (15)
- Block projection Π_kKeeps top-k blocks by norm.
- Block soft-thresholdProximal operator of the l2,1 norm used as activation.
- Fourier harmonic decomposition of curve blockDecomposes block contribution along orientation.
- Kohonen mapFitted to block manifold for grid steering.
- MACO feature visualizationUsed to visualize manifold locations.
- Matched null test for Fourier harmonicsRules out artifact reading of higher harmonics.
- Minimum description length (MDL)Criterion used to compare BSFs and SAEs.
- Per-block R² recovery metricScores recovery of each ground-truth factor.
- Quantization task-floor estimationEstimates reconstruction fidelity tasks require.
- Single-concept F1 class detectionTests class selectivity of blocks.
- Sparse Autoencoders (SAEs)Unsupervised baseline method for decomposing activations into sparse linear combinations; NLAs positioned as complementary approach.
- Stable rank analysisQuantifies intrinsic dimension of per-block codes.
- Total variation and Dirichlet energy smoothnessMeasures spatial coherence of concept maps.
- Toy model of manifold superpositionSynthetic benchmark with known ground-truth manifolds.
- Two-resolution reading of block codesBlock norm for presence; PCA coordinates for intrinsic geometry.
Frameworks (11)
- Additive Mixture of Manifolds modelData-generating process: activation is sparse sum of low-dimensional manifold points.
- Block-Sparse Featurizers (BSF)Featurizers whose atoms are blocks of directions rather than single directions.
- Energy modelClassical complex-cell model by Adelson & Bergen.
- Grassmannian BSFTied encoder/decoder with orthonormal charts and learned scalar gamma.
- Group Lasso BSFLinear encoder with block soft-threshold and group lasso penalty.
- HMAXCortical pooling model contrasted with block coordinate reading.
- Independent subspace analysisLearns subspaces with phase invariance; precursor.
- Mixture of Factor Analyzers (MFA)Mixture-based subspace featurizer; one-active-block special case.
- SMixAEConcurrent subspace featurizer repaired by block projection.
- Structured sparsityClassical literature on sparsity priors over admissible supports.
- Vanilla BSFFree encoder/decoder with block top-k projection.
Datasets (6)
- ADE20k and NYUv2Segmentation and depth probes.
- Blender lighting sweep of twelve modelsControlled rendered data with sun azimuth/elevation sweeps.
- DINOv3Main vision model whose activations are decomposed.
- ImageNet-1kTraining/evaluation data for class detectors and probes.
- InceptionV1 curve detectorsKnown-ground-truth setting for validating BSFs.
- SDXLDiffusion model on which steering is demonstrated.
Findings (20)
- Optimal block dimension is ≈3 for Grassmannian but nearer k∈{1,2,3} for the untied Block featurizer; Group Lasso tolerates largest blocks at higher residual cost.
Featurizer-specific optima.
- Two DINOv3 blocks track scene luminance and cast-shadow volume across twelve Blender models, with block norm following ground-truth luminance at every elevation.
Lighting/shadow manifold.
- Grassmannian BSF with b>1 describes DINOv3 activations in fewer bits than the b=1 SAE at every width and sparsity, minimum at b between 2 and 4.
MDL result at 20% distortion.
- Kohonen-grid steering within SDXL blocks produces regionally similar images revealing geometric organization, with non-interpretable grid axes.
Fig. 15.
- A single Grassmannian BSF block covers all curve orientations of InceptionV1 as one connected manifold, whereas neurons and SAE atoms tile it.
Curve manifold recovery.
- Held-out reconstruction R² rises monotonically with dictionary width, sparsity and block dimension for all three featurizers.
Reconstruction cannot rank featurizers.
- Measured manifold has 18.3% and 12.0% variance at k=2 and 3 versus ≈0.04% in matched null, exceeding it 470× and 314×.
Null test numbers.
- A DINOv3 Grassmannian block recovers a cabbage/cauliflower manifold with smooth feature-visualization transitions.
Fig. 10.
- All three BSFs recover toy manifold factors with per-block R² between 0.93 and 0.97 against an oracle of 0.99.
Toy superposition recovery.
- On DINOv3, classification and segmentation tolerate R²≈0.8, while depth needs R²≈0.9 to retain 95% accuracy.
Task-dependent distortion floors.
Claims (19)
- Unlike complex-cell pooling, a block-sparse featurizer retains the internal coordinate, separating representing a factor from being invariant to it.
Discussion of cortical analogy.
- Movement confined to the block subspace stays on the natural-image manifold and maintains semantic relevance, unlike arbitrary directions.
Rationale for manifold steering.
- Block sparsity is the prior matched to a generative model in which a representation is a sparse sum of low-dimensional manifolds.
Main theoretical claim, Prop. 1.
- Second and third harmonics are genuine periodic structure inherited from the network, not artifacts of noise, subspace or SAE.
Conclusion of null test.
- A penalty intrinsic to a feature must be blind to basis choice, leaving only the l2 norm; the atomic unit is the subspace.
Rotation-invariance argument.
- The role of interpretability is not only to decompose representations into atoms but to infer what the atoms must be.
Closing position.
- DINOv3 blocks are on average roughly three-dimensional, perhaps inherited from the visuospatial nature of the tasks.
Interpretation of stable rank.
- The mixture of manifolds is a model, not the last word; other modalities will need featurizers with non-block atoms.
Stated limitation.
- From an MDL standpoint, block sparsity affords a more compact description of activations than directional SAEs.
Support-term savings.
- Multiplicity of SAE curve features is an artifact of the featurizer, not a property of the network.
Reinterpretation of curve detectors.
Hypotheses (4)
- If BSFs capture concepts, moving within a block should manipulate behavior according to concept geometry.
Motivates diffusion steering.
- The same block construction predicts a richer contour code (curvature plus position) in deeper layers.
Forward prediction analogous to V4.
- A block-sparse code should hold the curve manifold together where a directional code fragments it.
Prediction tested on InceptionV1.
- Some blocks may track physical attributes of a scene rather than objects.
Motivates lighting search.
Questions (5)
- What is the optimal block dimension and what is the typical dimensionality of a concept?
Motivates stable-rank study.
- How can the sparsity prior be adapted to different types of representations?
Structured sparsity question.
- What should be unit of analysis for decomposing a representation?
Structured sparsity interpretability question.
- What is the admissible geometry of such a unit?
Structured sparsity question.
- What is the geometry of a visual percept?
Opening question.
Original abstract (expand)
What is the geometry of a visual percept? The most widely used protocols for decomposing neural network representations into interpretable parts treat concepts as isolated directions, yet recent work shows that concepts are often realized as geometric structures in low dimensional regions of activation space. We turn to the literature of Structured sparsity to close this gap, and show that block sparsity, which groups directions into blocks, is the prior matched to a generative model in which a representation is a sparse sum of low-dimensional manifolds: the modern, learned form of a classical idea in visual neuroscience, where a visual feature is carried by a coordinated group of neurons rather than a single tuned one. We implement three variants of block-sparse featurizers (BSFs) and, through a minimum-description-length analysis, show that all three describe activations more compactly than direction-based featurizers, with the recovered concepts typically two- to four-dimensional. We then use BSFs to (i) recontextualize prior work, showing that curve detectors in InceptionV1 actually read from a single continuous curve manifold, (ii) discover novel manifolds including shadows and lighting in DINOv3, and (iii) support interpretable control of image generation in diffusion models (SDXL) via manifold steering.
Related work— refs + corpus + external arXiv
Cited / in-corpus / arXiv badges show which signals surfaced each row. Multi-source rows weighted higher.
- Do Sparse Autoencoders Capture Concept Manifolds?citedin corpus2026≈ 86%
- ≈ 84%
- ≈ 82%
- When Models Manipulate Manifolds: The Geometry of a Counting Taskcitedin corpus2026≈ 82%
- Open Problems in Mechanistic Interpretabilitycitedin corpus2025≈ 79%
- Sparsification and Reconstruction from the Perspective of Representation GeometryBingzhe Wu, Zhile Yang, Chengke Wu Wenjie Sun2025≈ 84%
- SCALAR: Benchmarking SAE Interaction Sparsity in Toy LLMsAndrew Gordon, Peter Lai, Xavier Poncini, David Quarel, and Stefan Heimersheim Sean P. Fillingham2025≈ 84%
- How Pruning Reshapes Features: Sparse Autoencoder Analysis of Weight-Pruned Language ModelsElies Segu\'i-Mas, Guillermina Tormo-Carb\'o Hector Borobia2026≈ 83%
- Sparse but not Simpler: A Multi-Level Interpretability Analysis of Vision TransformersSiyu Zhang2026≈ 83%
- Fundamental Limits of Neural Network Sparsification: Evidence from Catastrophic Interpretability CollapseRajiv Misra, Sanjay Kumar Singh Dip Roy2026≈ 83%
- Sparse Semantic Dimension as a Generalization Certificate for LLMsAsif Ekbal Dibyanayan Bandyopadhyay2026≈ 83%
- Improving Sparse Autoencoder with Dynamic AttentionJinsen Zhang, Dawei Su, Hui Huang Dongsheng Wang2026≈ 83%
- Train One Sparse Autoencoder Across Multiple Sparsity Budgets to Preserve Interpretability and AccuracyYaroslav Aksenov, Daniil Laptev, Vadim Kurochkin, Gleb Gerasimov, Nikita Koryagin, Daniil Gavrilov Nikita Balagansky2025≈ 82%
- A Unified Theory of Sparse Dictionary Learning in Mechanistic Interpretability: Piecewise Biconvexity and Spurious MinimaHarshvardhan Saini, Zhaoqian Yao, Zheng Lin, Yizhen Liao, Jingyi Cui, Yisen Wang, Mengnan Du, Dianbo Liu Yiming Tang2026≈ 82%
- The Geometric Wall: Manifold Structure Predicts Layerwise Sparse Autoencoder Scaling LawsMaciej Trzaskowski, Quan Nguyen, Fred Roosta Eslam Zaher2026≈ 82%
- Superposition as Lossy Compression: Measure with Sparse Autoencoders and Connect to Adversarial VulnerabilityLeonard Bereska and Zoe Tzifa-Kratira and Reza Samavi and Efstratios Gavves2025≈ 82%
- ≈ 82%
- Resurrecting the Salmon: Rethinking Mechanistic Interpretability with Domain-Specific Sparse AutoencodersMudith Jayasekara, Max Kirkby Charles O'Neill2025≈ 82%
- Toy Models of Superpositionin corpus2022≈ 82%
- Improving Robustness In Sparse Autoencoders via Masked RegularizationKowshik Thopalli, Bhavya Kailkhura and Wesam Sakla Vivek Narayanaswamy2026≈ 82%
- Step-Level Sparse Autoencoder for Reasoning Process InterpretationJiayu Liu, Yuhang Lai, Hao Xu, Zhenya Huang, Ning Miao Xuan Yang2026≈ 81%
- What Cohort INRs Encode and Where to Freeze ThemSophie Starck, Robbie Holland, Julian McGinnis, Daniel Rueckert Vasiliki Sideri-Lampretsa2026≈ 81%
- ≈ 81%
- SAEBench: A Comprehensive Benchmark for Sparse Autoencoders in Language Model Interpretabilityin corpus2025≈ 80%
- ≈ 80%
- Stochastic Parameter Decompositionin corpus2025≈ 80%
- Mechanistic Knobs in LLMs: Retrieving and Steering High-Order Semantic Features via Sparse Autoencodersin corpus2026≈ 80%
- Anatomy of Post-Training: Using Interpretability to Characterize Data and Shape the Learning Signalin corpus2026≈ 79%
- The World Inside Neural Networksin corpus2026≈ 79%
- ≈ 76%
+18 more