finding
active
finding:swapping-texas-features-for-california-features-from-oakland-prompt-makes-claude-3-5-haiku-output-sacramentoSwapping Texas features for California features (from Oakland prompt) makes Claude 3.5 Haiku output Sacramento.
Validates intermediate Texas representation.
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- In the Dallas example the model performs genuine two-step reasoning internally, coexisting with shortcut reasoning.associated_withsupportsCentral introductory claim.
Hypotheses (1)
hypothesis
- If completion is mediated by a Texas step, swapping Texas features for another state should change the capital output.associated_withsupportsPrediction tested by feature swapping.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Systematic reasoning evaluation.
- Multilingual features grow with scale.
- Empirical observation of feature splitting.
- Judge sensitivity.
- Mechanism limitation.
- Capabilities.
- Full evolver-side SWE results showing comparable performance across Claude family tiers
- Task competence.