finding
active
finding:brute-force-search-achieves-maximum-iia-of-0-60-on-monli-tasksBrute-force search achieves maximum IIA of 0.60 on MoNLI tasks
DAS substantially outperforms brute-force search on MoNLI across all models.
Source paper
extracted_from(2023) · Atticus Geiger · Zhengxuan Wu · Christopher Potts · Thomas Icard +1
Neighborhood — ranked by edge-count
Claims (1)
claim
- Second central claim of the paper.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Brute-force search achieves best IIA of 0.60 on hierarchical equality Both Equality Relations in Layer 1finding0.835DAS substantially outperforms brute-force search (1.00 vs 0.60 IIA) on the hierarchical equality task.
- Likely-trained MM probe is a surprisingly effective causal baseline due to correlation between truth and probability on sp_en_trans
- Localist methods fail entirely on MoNLI distributed representations.
- Baseline accuracy showing small models fail on harder NPI licensing tasks
- Training progression result showing non-linear maps are uncorrelated with genuine task learning
- Asserts that the method maintains efficiency across a range of constraint strengths without degradation.
- Demonstrates that high IIA can be obtained even when model cannot solve the task
- Corroborating result on additional task confirming main paper findings