finding
active
finding:binarized-dna-proxy-has-pearson-correlation-of-0-80-with-a-1-2937-feature-activationsBinarized DNA proxy has Pearson correlation of 0.80 with A/1/2937 feature activations
Demonstrates specificity and sensitivity of DNA feature
Source paper
extracted_from(2024) · Marc Carauleanu · Michael Vaiana · Judd Rosenblatt · Cameron Berg +1
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Universality of DNA feature across two transformer models with different random seeds
- Pearson correlation of 0.74 between A/1/3450 activation and Arabic script proxy over 40M tokensfinding0.840Joint measure of sensitivity and specificity for the Arabic script feature
- Universality of base64 feature across two transformers
- Demonstrates that activation similarity can diverge from logit weight similarity due to interference
- Universality of Hebrew script feature across two transformers
- Arabic feature A/1/3450 and B/1/1334 have activation correlation of 0.91 across 40M tokensfinding0.776Demonstrates universality of the Arabic script feature across two independently trained transformers
- Systematic comparison showing features are substantially more universal than neurons across models
- SAE features are not simply mirroring individual neurons.