concept
active
concept:using-fast-weights-to-attend-to-the-recent-past-ba-et-al-2016aUsing Fast Weights to Attend to the Recent Past (Ba et al., 2016a)
Previous work viewing fast weights as alternative to LSTM; noted as prior context for TEM's fast weight memory.
Neighborhood — ranked by edge-count
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The ability in Elephant to refer to past events and states without explicit data structures.
- Expected limitation.
- Claim about the radical novelty of high-speed adaptive production.
- Abstract thesis.
- Structured sparsity question.
- Load-bearing claim about the tractability of circuit analysis; central thesis of Claim 2
- Three regimes by effectiveness.
- Helpful and harmful weights are scattered across the entire range of virtual weight magnitudesfinding0.716IN Tokens→Logits shows weak VW-helpfulness relationship.