finding
active
finding:relu-hidden-layer-model-circumvents-the-relu-by-using-positive-biases-or-simulating-bias

ReLU hidden layer model circumvents the ReLU by using positive biases or simulating bias

Limitation of that toy model.

Source paper

extracted_from
Toy Models of Superposition
(2022) ·

Neighborhood — ranked by edge-count

Papers (1)

paper

Frameworks (1)

framework

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.