concept
active
concept:gradient-starvation

Gradient starvation

Prior account of infrequent tasks having gradients starved out.

Neighborhood — ranked by edge-count

Concepts (1)

concept

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Gradient Descentmethod0.803
    Used for updating hidden state expectations; provides dynamical process theory testable against neuronal data
  • Gradientsconcept0.783
    The property that qualities vary slowly, subtly, gradually across the extent of each living thing; gradients arise as natural responses to changing circumstances and create field-like character that points toward and establishes centers
  • During RL training on ATLAS, sparse functional tokens (2.3% of sequences) receive diluted gradient signals from sequence-level advantages propagated across all tokens.
  • Gradient methodmethod0.766
    Optimization technique that computes weight changes by following the gradient of an error function; contrasted with evolutionary stochastic search.
  • Gradient conflictconcept0.764
    When gradients of different tasks have negative cosine similarity, harming multi-task learning.
  • Secondary restoration problem involving insufficient physical habitat structure in riverscapes.
  • Optimization procedure for simultaneously updating action selection and perception; uses step size ζ (default 4).
  • Gradient maskingconcept0.740
    Adversarial robustness phenomenon by which a transcoder could cheat Jacobian matching.