finding
active
finding:without-repetition-transcoder-on-abs-problem-learns-almost-exactly-relu-x-i-and-relu-x-i-features-with-small-residual

Without repetition, transcoder on abs problem learns almost exactly ReLU(x_i) and ReLU(-x_i) features with small residual

Baseline toy experiment.

Source paper

extracted_from
A Toy Model of Mechanistic (Un)Faithfulness
Chris Olah

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.