finding
active
finding:in-a-gemma-2-2b-tfa-2k-dictionary-elements-define-predictive-code-and-8k-novel-code-effective-rank-is-20-30-for-predictive-vs-390-410-for-novelIn a Gemma-2-2B TFA, ~2K dictionary elements define predictive code and ~8K novel code; effective rank is ~20–30 for predictive vs ~390–410 for novel.
Fig. 58.
Source paper
extracted_from(2025) · Lubana, Ekdeep Singh · Rager, Can · Hindupur, Sai Sumedh R. · Costa, Valerie +12
Neighborhood — ranked by edge-count
Papers (1)
paper
Concepts (1)
concept
- Rank sparsitysupportsAlternative sparsity notion proposed for predictive component.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Table 3.
- Fig. 10.
- Fig. 11.
- Fig. 9b.
- Fig. 26.
- Fig. 9c, Fig. 37.
- Table 1.
- Table 3.