finding
active
finding:relu-makes-negative-interference-free-in-the-1-sparse-case

ReLU makes negative interference free in the 1-sparse case

Explains preference for negative interference.

Source paper

extracted_from
Toy Models of Superposition
(2022) ·

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.