concept
active
concept:inductive-bias

Inductive Bias

Assumptions or preferences (e.g., parsimony) that determine how a learning system generalizes beyond training data

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Bias Amplificationconcept0.806
    Problem cited as a limitation of current LLMs; PRH predicts larger models should amplify bias less
  • Von Foerster's view that memory is fundamentally generalization, not inherently temporal.
  • Simplicity Biasconcept0.757
    The tendency of deep networks to implicitly favor simpler solutions that fit the data, driving convergence
  • Deep networks are biased toward finding simple fits to data, and this bias increases with model size, driving convergence
  • Pre-Encoder Biasconcept0.748
    Architectural modification subtracting a learned bias from autoencoder inputs before encoding; initialized to geometric median of dataset; improves autoencoder performance
  • Features related to gender, racial, ethnic biases, slurs, and hate speech.
  • Metric for intervention effectiveness: 0 = ineffective, 1 = full flip of model output from false to true or vice versa
  • The process of inferring causes of sensory inputs, a key aspect of the free-energy minimization scheme.