So et al. (Primer)

Authors of the Primer architecture discovered via automated search; their depthwise convolution on keys/queries would make induction heads expressible without K-composition