claim
active
claim:neural-networks-are-not-inscrutable-black-boxes-interpreter-models-can-parse-activations-into-often-human-understandable-featuresNeural networks are not inscrutable black boxes: interpreter models can parse activations into often human-understandable features
Central framing claim.
Source paper
extracted_fromNeighborhood — ranked by edge-count
Papers (1)
paper
Findings (1)
finding
- LMSYS-Chat-1M SAE produced the most effective features for chat applications on Llama-3-8B-InstructsupportsResult of extensive hyperparameter and dataset experimentation.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Can an interpretable symbolic algorithm be used to faithfully explain a complex neural network model?question0.791Framing question for the paper's research program.
- Vision statement in the conclusion.
- Load-bearing framing of the core interpretability problem: neural networks encode algorithms in parameter matrices rather than human-readable code.
- The field aimed at understanding what neural networks have learned; characterized as pre-paradigmatic in this paper
- Paper explicitly identifies this as a current gap requiring alternative experimental approaches
- The paper's central thesis statement, presented prominently after the abstract
- Extends convergence argument to brain-machine alignment