method
active
method:broadcast-head-identification-gain-label-preservationBroadcast head identification (gain + label preservation)
Finds attention heads relaying J-space content.
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- MLP and attention analysis.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Mathematical equivalence enabling independent analysis of each attention head
- Availability of information in the workspace to all modules.
- Reduction in uncertainty about hidden states or parameters, driving exploration.
- Analysis measuring whether each attention head's maximum attention increase points to the correct injected sentence
- Logic seen as conservation laws for information flow; proofs correspond to generalized copy-cat strategies.
- Indicator: global broadcast to all modules.
- Expectation for decomposition.