Pass Rate

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Pass Rate Scoringmethod0.892
  Primary metric for all benchmarks, measuring fraction of tasks that meet benchmark-specific pass criteria
• Pass-When-Loaded Rateconcept0.832
  The pass rate among a model's skill-loaded trajectories, measuring outcome conditioned on harness activation
• refusal rateconcept0.787
  The percentage of harmful requests that a model refuses to answer, a common safety metric.
• Learning Rateconcept0.786
  Hyperparameter for optimizing model parameters through learning in active inference.
• Sink Ratemethod0.756
  Fraction of attention heads with sink score above threshold 0.3, used to track stages of inference
• Reflection rateconcept0.756
  Ratio of reflection steps to total reasoning steps, used to quantify reflection behavior
• Rate overloadconcept0.731
  TUAI failure mode: generating normative predictions faster than they can be fulfilled.
• Skill-Load Rateconcept0.725
  The fraction of trajectories in which an agent actively loads at least one skill into its context