concept
active
concept:self-attn-o-proj-moduleself_attn.o_proj Module
The attention output projection layer where SOO Loss is computed; maps multi-head attention outputs to hidden dimension
Neighborhood — ranked by edge-count
Methods (1)
method
- The specific implementation of SOO loss using MSE between self_attn.o_proj outputs at a specified layer
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The interior awareness, consciousness, and felt identity that each person experiences; absent from mechanistic cosmology.
- Process of reifying one's identity as an independent self; meditation practices aim to decrease selfing.
- The personal experience of being a self, which is left out of the mechanistic world-picture but is central to the new wholeness-based view.
- The single blinding unity, the ground of being, which living centers connect us to.
- Primary self-report measure: probability-weighted expected value over all ten digit-token logits, yielding a continuous rating that preserves full distributional signal
- The transformer's model of itself as a predictive text engine, developed through in-context learning.
- Related technique improving multi-agent learning by predicting others' actions using an agent's own policy