finding
active
finding:pearson-correlation-of-0-74-between-a-1-3450-activation-and-arabic-script-proxy-over-40m-tokensPearson correlation of 0.74 between A/1/3450 activation and Arabic script proxy over 40M tokens
Joint measure of sensitivity and specificity for the Arabic script feature
Source paper
extracted_from(2024) · Marc Carauleanu · Michael Vaiana · Judd Rosenblatt · Cameron Berg +1
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Demonstrates specificity and sensitivity of DNA feature
- Arabic feature A/1/3450 and B/1/1334 have activation correlation of 0.91 across 40M tokensfinding0.837Demonstrates universality of the Arabic script feature across two independently trained transformers
- Demonstrates activation specificity of the Arabic script sparse autoencoder feature
- Universality of Hebrew script feature across two transformers
- Universality of base64 feature across two transformers
- Demonstrates that activation similarity can diverge from logit weight similarity due to interference
- Universality of DNA feature across two transformer models with different random seeds
- Key quantitative evidence that detection signal is identical to global logit shift confound