finding
active
finding:lmsys-chat-1m-sae-produced-the-most-effective-features-for-chat-applications-on-llama-3-8b-instruct

LMSYS-Chat-1M SAE produced the most effective features for chat applications on Llama-3-8B-Instruct

Result of extensive hyperparameter and dataset experimentation.

Neighborhood — ranked by edge-count

Datasets (1)

dataset
  • Chat dataset (n=18,777 sampled) used to measure how much persona space PCs explain overall activation variance and to calibrate steering norms

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.