Golden Gate Bridge feature [34M/31164353] fires strongly on Wikipedia snippets in Chinese, Japanese, Korean, Russian, Vietnamese, Greek.

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Golden Gate Bridge feature neighborhood includes Alcatraz, Presidio, Lake Tahoe, Yosemite; decoder cosine similarity maps onto semantic relatedness.finding0.794
  Example of geometric clustering of features.
• Clamping Golden Gate Bridge feature to 10x max activation caused the model to self-identify as the Golden Gate Bridge.finding0.785
  Strong causal evidence that the feature represents the bridge.
• For four example features (Golden Gate Bridge, brain sciences, monuments, transit infrastructure), all strong activations (top bucket) received specificity rating 3 from Claude 3 Opus.finding0.763
  Validation that top activations are highly specific to interpretation.
• The Golden Gate Bridgeconcept0.742
  Example: a bridge whose construction process and sensitive placement intensified the natural beauty of the gap.
• Hebrew feature A/1/416 and B/1/1901 have activation correlation of 0.92finding0.724
  Universality of Hebrew script feature across two transformers
• A 'San Francisco' feature in 1M SAE splits into 11 fine-grained features in 34M SAE.finding0.724
  Empirical observation of feature splitting.
• Arabic feature A/1/3450 and B/1/1334 have activation correlation of 0.91 across 40M tokensfinding0.701
  Demonstrates universality of the Arabic script feature across two independently trained transformers
• Base64 feature A/1/2357 and B/1/2165 have activation correlation of 0.85finding0.700
  Universality of base64 feature across two transformers