method
active
method:batchtopk-sparsityBatchTopK sparsity
Sparsity activation used with k=200.
Neighborhood — ranked by edge-count
Papers (1)
paper
Frameworks (1)
framework
- Architectural variant partitioning the dictionary into A-exclusive, B-exclusive and shared sets.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Evaluated architecture.
- Property that features activate on only a small fraction of inputs; enables compressed sensing and is what allows superposition to work
- Frontier ranking differs from other metrics.
- Classical literature on sparsity priors over admissible supports.
- Alternative sparsity notion proposed for predictive component.
- The balance between how sparse and how faithful a decomposition is; VPD achieves a better tradeoff than transcoders.
- Expected limitation.
- Hierarchical architecture that excels on disentanglement and scales positively.