finding
active
finding:pruning-least-effective-70-of-vw-weights-worsens-loss-by-0-01-nats

Pruning least effective 70% of VW weights worsens loss by ~0.01 nats

Fisher-effectiveness pruning at 30% density.

Source paper

extracted_from
Characterizing interference weights in a tiny language model
Nicholas L. Turner · Jeffrey Wu · Joshua Batson

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.