claim
active
claim:helpfulness-is-close-to-a-ground-truth-measure-of-a-weight-s-functional-importanceHelpfulness is close to a ground-truth measure of a weight's functional importance
Reads loss change directly.
Source paper
extracted_fromNicholas L. Turner · Jeffrey Wu · Joshua Batson
Neighborhood — ranked by edge-count
Papers (1)
paper
Findings (1)
finding
- Three regimes by effectiveness.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Average change in loss when a weight is ablated.
- Estimates density floor.
- Helpful and harmful weights are scattered across the entire range of virtual weight magnitudesfinding0.762IN Tokens→Logits shows weak VW-helpfulness relationship.
- The standard paradigm of open post-training that character training goes beyond
- Sampled helpfulness mass.
- Preserving a fraction of sum of positive helpfulness to estimate density.
- Emphasizes the importance of full-scale physical judgment over scaled drawings.