finding
active
finding:a-model-1-the-size-of-gpt-3-outperforms-humans-on-next-token-prediction

A model 1% the size of GPT-3 outperforms humans on next-token prediction

Evidence humans and AI use different representations.

Source paper

extracted_from
Open Problems in Mechanistic Interpretability
(2025) · Lee Sharkey · Bilal I. Chughtai · Joshua Batson · Jack W. Lindsey +25

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.