finding
active
finding:adding-mistakes-aoc-ordering-of-tasks-nearly-identical-to-early-answering-differing-only-in-hellaswag-ranked-above-mmluAdding mistakes AOC ordering of tasks nearly identical to early answering, differing only in HellaSwag ranked above MMLU
Cross-test agreement.
Source paper
extracted_from(2023) · Tamera Lanham · Anna Chen · Ansh Radhakrishnan · Benoit Steiner +26
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Interpretation of early answering/mistakes results.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Table 2 early answering AOC.
- Only task with degradation.
- Table 2.
- Key improvement in cross-task generalization enabled by explicit instruction framing.
- Illustrates NLA's capture of high-level cognition and hallucination of specifics; corroborated with attribution graphs.
- Headline auditing result.
- Validates that inference stage observations are not specific to mathematical reasoning tasks
- Expected limitation.