Sauers' statistical anomaly: when models are given Janus post explaining transformers, reconstruction accuracy tails extend both ways, with ~1/1000 reconstructions anomalously accurate

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• giving models janus's thread extends reconstruction accuracy distribution tails in both directionsfinding0.852
  Sauers' study: exposing models to janus's post extended both positive and negative extremes of reconstruction accuracy.
• Sauers' reconstruction experimentmethod0.779
  Statistical method: ask model to recall random numbers from earlier outputs, with and without providing explanation of transformer architecture; measure reconstruction accuracy distribution.
• 3 of 64 simulated agents exhibited superstitious (incorrect) abduction, leading to persistently poor performance, demonstrating a trade-off between ampliative benefit and susceptibility to false insight.finding0.759
  Demonstration of failure mode of abductive model reduction
• Can natural language explanations of activations generated through unsupervised reconstruction genuinely capture model cognition?question0.758
  Core research question motivating NLA development and validation through case studies and causal interventions.
• Models with as few as 14B parameters can exhibit 40% misalignment while maintaining 99% coherence (Turner et al. 2025 result)finding0.755
  Concurrent work result showing emergent misalignment occurs in small models
• Cosine similarity between perturbed and baseline residual streams returns toward 1.0 and projection onto injection direction decays exponentially over subsequent layersfinding0.753
  Mechanistic evidence that network actively attenuates injected perturbations, explaining late-layer introspection failure
• Transformers are recurrent through autoregression because K/V stream provides horizontal information flow across positions.claim0.748
  Claim formalizing the Anima Labs idea that transformers are effectively recurrent due to K/V stream.
• Base models assign higher likelihood to typical-set (representative) sequences than to degenerate sequences under VS promptshypothesis0.746
  Assumption D.6 formalized in the theoretical framework; empirically validated with coin-flip typicality rating experiments