method
active
method:ground-truth-llm-judge-with-tailored-rubrics

Ground-truth LLM judge with tailored rubrics

Manually curated, triplicate-consensus judge used as ground truth.

Neighborhood — ranked by edge-count

Datasets (3)

dataset
  • Human-validated subset of SWE-bench containing 500 real GitHub issue tasks across 12 Python repositories used as agentic benchmark
  • Long-horizon SWE benchmark with high hack rates.
  • LiveCodeBench split with flawed tests used to measure exploit propensity.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.