community
active
leiden_hybrid_concepts
label: sonnet
community:leiden_hybrid_concepts-run2-c141Causal masking & phase transitions
Proves decoder-only causal attention lacks an ordered thermodynamic phase (Proposition 2).
1 members. Each node is clickable.
Loading graph…
Drawn from 1 source
The papers/notes whose extracted claims & findings make up this cluster.
Bridges (3)
Other communities that share members with this one — cross-cutting threads or papers that sit at the seam between two themes.
Findings (1)
- Causally-masked attention in a decoder-only model has no ordered phase (Proposition 2)Application to transformer language models