method
active
method:gradient-descent

Gradient Descent

Used for updating hidden state expectations; provides dynamical process theory testable against neuronal data

Neighborhood — ranked by edge-count

Frameworks (2)

framework

Concepts (1)

concept

Methods (1)

method
  • Gradient method
    related_to
    Optimization technique that computes weight changes by following the gradient of an error function; contrasted with evolutionary stochastic search.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Gradientsconcept0.882
    The property that qualities vary slowly, subtly, gradually across the extent of each living thing; gradients arise as natural responses to changing circumstances and create field-like character that points toward and establishes centers
  • Optimization procedure for simultaneously updating action selection and perception; uses step size ζ (default 4).
  • Baseline method against which probe-based ranking is compared; more computationally expensive.
  • Process by which neuronal dynamics minimize free energy; produces empirically observable neural phenomena.
  • A structure-preserving transformation: using gradual change across space to soften and intensify transitions.
  • DAS uses SGD over differentiable parameterizations of orthogonal matrices (via PyTorch) to find optimal distributed alignments.
  • Gradient conflictconcept0.810
    When gradients of different tasks have negative cosine similarity, harming multi-task learning.
  • Gradient balancing by solving multi-objective optimization for minimum-norm aggregated gradient.