question
active
question:do-we-assume-that-the-model-knows-something-we-don-t-or-are-these-interference-weights-contributing-noise

Do we assume that the model knows something we don't, or are these interference weights contributing noise?

Motivating question.

Source paper

extracted_from
Characterizing interference weights in a tiny language model
Nicholas L. Turner · Jeffrey Wu · Joshua Batson

Neighborhood — ranked by edge-count

Findings (2)

finding

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.