quote
active
quote:fast-forward-about-a-year-i-m-training-rnns-all-the-time-and-i-ve-witnessed-their-power-and-robustness-many-times-and-yet-their-magical-outputs-still-find-ways-of-amusing-meFast forward about a year: I'm training RNNs all the time and I've witnessed their power and robustness many times, and yet their magical outputs still find ways of amusing me.
Karpathy's quote expressing awe at char-RNNs, used to illustrate early generative models.
Source paper
extracted_fromRelated by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Models trained directly with asynchronous updates would exhibit even greater robustness than synchronously trained modelshypothesis0.734Hypothesis that motivated the asynchronous robustness comparison experiment
- Characteristic of a structure-preserving process.
- Argument that predictability is no longer an essential property distinguishing machines from life
- A predictive relation between care and intelligence enhancement.
- Correlates stable fixed-point behavior with out-of-domain generalization performance at test-time
- Argument that RL meets the agency indicator.
- If we do one thing at a time, and if what we do is wholesome and sound, then whatever comes next will work.hypothesis0.708A predictive statement encapsulating the confidence of living process.
- Interpretive claim that circuits render raw weights interpretable as algorithmic structures