paper
active
2026
paper:doi-10-48550-arxiv-2606-25234

Structuring Sparsity: Block-Sparse Featurizers Capture Visual Concept Manifolds

TL;DR

Lifting the featurizer's atom from a direction to a block of directions recovers concept manifolds that SAEs shatter, and block sparsity is the MAP-matched prior for a representation that is a sparse Minkowski sum of low-dimensional manifolds. The paper introduces block-sparse featurizers (BSFs) in three variants: Vanilla (top-k blocks by norm, untied encoder), Grassmannian (tied encoder with orthonormal charts), and Group Lasso (block soft-threshold). On a synthetic manifold-superposition toy, all three reach per-block R² of 0.93–0.97 against an oracle of 0.99, while a TopK SAE collapses to 0.53. On DINOv3 ViT-B, a minimum-description-length analysis at the 20% distortion floor shows blocks of dimension 2–4 describe activations in fewer bits than b=1 SAEs at every dictionary width and sparsity, and stable rank saturates near 3 even when b=16 is allowed. In InceptionV1, the curve-detector neurons and SAE atoms are fragments of one curve manifold, whose first three Fourier harmonics carry 89% of variance (59/18/12%) and survive a matched null by factors of 470 and 314. A DINOv3 block tracks sun luminance and shadow across twelve Blender models, and SDXL blocks support manifold steering, as in the pretzel block. The implication is that a featurizer is a hypothesis about the data-generating process, so interpretability should infer what the atoms must be rather than assume them. Blocks are one answer, matched to vision but probably not to language.

What to take away

  1. 1. On a synthetic additive-manifold toy (M=128 factors, d=128, circles, spheres, tori, Möbius strips, Swiss rolls), all three BSFs reach per-block R² of 0.93–0.97 against an oracle ceiling of 0.99, while a TopK SAE reaches only about 0.53.
  2. 2. Block sparsity falls out as the MAP estimate under a spike-and-slab block prior (Proposition 1), and the penalty must depend on a block only through its ℓ2 norm because the chart is defined only up to O(b) rotation.
  3. 3. At a 20% distortion floor (R²≈0.8), the Grassmannian BSF describes DINOv3 ViT-B activations in fewer bits than the b=1 SAE at dictionary widths from 8x to 64x expansion, with the minimum at b between 2 and 4.
  4. 4. Mean stable rank of per-block codes saturates near 3 even when blocks are allotted up to b=16, so DINOv3 concepts average roughly three dimensions, while Group Lasso utilization collapses to about 0.17 at b=16 versus 0.6–0.66 for the other two.
  5. 5. A single Grassmannian block with b=16 reconstructs the whole InceptionV1 curve manifold, with Fourier harmonics ω=1,2,3 carrying 59%, 18% and 12% of variance, which explains why some curve neurons wrap at 180° (the ω=2 harmonic).
  6. 6. A matched null (orientation plus white-in-θ noise of 56% input variance) puts only 0.04% of variance in harmonics k≥2, so the measured 18.3% and 12.0% at k=2 and k=3 exceed it by factors of about 470 and 314.
  7. 7. Mean per-concept smoothness improves with block size: at k=64 active blocks, DINOv3 concept maps are roughly five times smoother (total variation) at b=4 than at b=1, and best single-class F1 on ImageNet-1k beats the SAE at every sparsity.
  8. 8. Ranking blocks by co-variation of their contribution with sun azimuth and elevation across twelve Blender models found one luminance block and one cast-shadow block whose norm follows ground-truth luminance at every elevation and across object identities.
  9. 9. Replacing SMixAE's rectifier with a signed code and block projection lifts its toy R² from 0.71 to 0.85, and decoding MFA's learned subspaces additively lifts it from 0.38 to 0.88, because MFA's mixture assumes exactly one active component (|S|=1) and cannot represent a Minkowski sum.
  10. 10. Open question: the authors suspect block sparsity will mismatch language and video representations the way SAEs mismatch manifolds, so hierarchical, temporal or compositional geometry may need different atoms, and the predicted richer curvature code in deeper layers (V4-like) is untested.

Peer brief — for seminar discussion

This work argues that a featurizer is a hypothesis about how activations are generated, and that the SAE hypothesis of one direction per concept is mismatched to manifold-structured representations. Starting from the additive mixture of manifolds model of Bhalla et al. (activations as a Minkowski sum of low-dimensional manifolds), the authors show that block sparsity is the MAP-matched prior (Proposition 1, spike-and-slab on blocks). They build block-sparse featurizers (BSFs) in three variants: Vanilla top-k, Grassmannian with tied orthonormal charts, and Group Lasso with a block soft-threshold. The alternative route they could have taken is a manifold-learning or sparse-subspace-clustering method such as Isomap or SSC, which they dismiss in the appendix because those methods assume a single manifold or subspace per point. Their MAP result also implies that a Laplace slab gives the group-lasso penalty exactly. The load-bearing evidence is threefold. On a synthetic toy with 128 factors in d=128, BSFs reach per-block R² of 0.93–0.97 versus 0.53 for a TopK SAE and an oracle of 0.99. On DINOv3 ViT-B, a minimum-description-length criterion (needed because reconstruction rises monotonically with every structural parameter) favors blocks of dimension 2–4 over b=1 at every width, and stable rank saturates near 3. In InceptionV1, one block holds the entire curve manifold, with Fourier harmonics carrying 59/18/12% of variance and surviving a matched null. Further demonstrations include a luminance block and a shadow block tracked against Blender ground truth, and SDXL manifold steering via a Kohonen map. The implication is that SAE feature splitting and tiling, such as per-orientation curve atoms, is a predictable artifact of a mismatched prior rather than a property of the network. It also suggests that reading the block coordinate keeps information that complex-cell-style pooling discards. A critical reader would push on several points. The MDL comparison depends on the chosen distortion floor, a Gaussian rate approximation, and shallow minima on a coarse grid, which the appendix concedes; only the direction of the effect is robust. The toy is generated from the very model the prior is derived from, so its recovery is partly circular, and the SMixAE and MFA repairs are tuned post hoc. The subspace assumption (each factor spans a linear b-dimensional space) is stronger than low intrinsic dimension. Steering and the pretzel and cabbage manifolds are qualitative, with no quantitative comparison to SAE steering. Finally, the claim that a block carries one concept is partly an interpretive choice, since stable rank is below the allotted dimension and Group Lasso utilization collapses to 0.17 at b=16. The paper's forward hypothesis is that deeper layers will show richer contour codes, and that language and video will need other atoms.

Methods (15)

Frameworks (11)

Datasets (6)

Findings (20)

Claims (19)

Original abstract (expand)

What is the geometry of a visual percept? The most widely used protocols for decomposing neural network representations into interpretable parts treat concepts as isolated directions, yet recent work shows that concepts are often realized as geometric structures in low dimensional regions of activation space. We turn to the literature of Structured sparsity to close this gap, and show that block sparsity, which groups directions into blocks, is the prior matched to a generative model in which a representation is a sparse sum of low-dimensional manifolds: the modern, learned form of a classical idea in visual neuroscience, where a visual feature is carried by a coordinated group of neurons rather than a single tuned one. We implement three variants of block-sparse featurizers (BSFs) and, through a minimum-description-length analysis, show that all three describe activations more compactly than direction-based featurizers, with the recovered concepts typically two- to four-dimensional. We then use BSFs to (i) recontextualize prior work, showing that curve detectors in InceptionV1 actually read from a single continuous curve manifold, (ii) discover novel manifolds including shadows and lighting in DINOv3, and (iii) support interpretable control of image generation in diffusion models (SDXL) via manifold steering.

Related work— refs + corpus + external arXiv

Cited / in-corpus / arXiv badges show which signals surfaced each row. Multi-source rows weighted higher.

+18 more

Similar preprints — Semantic Scholar