concept
active
concept:pass-when-loaded-rate

Pass-When-Loaded Rate

The pass rate among a model's skill-loaded trajectories, measuring outcome conditioned on harness activation

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Primary metric for all benchmarks, measuring fraction of tasks that meet benchmark-specific pass criteria
  • Rate overloadconcept0.785
    TUAI failure mode: generating normative predictions faster than they can be fulfilled.
  • Skill-Load Rateconcept0.774
    The fraction of trajectories in which an agent actively loads at least one skill into its context
  • Named metric measuring the fraction of trajectories in which a model actively loads at least one skill into its context
  • Dynamic Loadingmethod0.737
    Modules loaded on demand at command invocation or through programmed calls; no separate linker; each module present once in memory.
  • refusal rateconcept0.717
    The percentage of harmful requests that a model refuses to answer, a common safety metric.
  • Learning Rateconcept0.712
    Hyperparameter for optimizing model parameters through learning in active inference.
  • Reflection rateconcept0.712
    Ratio of reflection steps to total reasoning steps, used to quantify reflection behavior