finding
active
finding:transformer-training-loss-fell-from-8-93-to-3-33-over-11-933-steps-test-loss-3-38

Transformer training loss fell from 8.93 to ~3.33 over 11,933 steps; test loss 3.38

Training results.

Source paper

extracted_from
Characterizing interference weights in a tiny language model
Nicholas L. Turner · Jeffrey Wu · Joshua Batson

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.