Inductive Bias

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Bias Amplificationconcept0.806
  Problem cited as a limitation of current LLMs; PRH predicts larger models should amplify bias less
• memory as inductive inferenceconcept0.758
  Von Foerster's view that memory is fundamentally generalization, not inherently temporal.
• Simplicity Biasconcept0.757
  The tendency of deep networks to implicitly favor simpler solutions that fit the data, driving convergence
• Simplicity Bias Hypothesishypothesis0.757
  Deep networks are biased toward finding simple fits to data, and this bias increases with model size, driving convergence
• Pre-Encoder Biasconcept0.748
  Architectural modification subtracting a learned bias from autoencoder inputs before encoding; initialized to geometric median of dataset; improves autoencoder performance
• Typicality Bias Ratemethod0.738
  Measurement of how often human annotators prefer the response with higher base model log-probability
• Bias in language modelsconcept0.734
  Features related to gender, racial, ethnic biases, slurs, and hate speech.
• Typicality Biasconcept0.734
  The human tendency to prefer more typical, familiar, fluent, and predictable text in annotation tasks, identified as a fundamental data-level cause of mode collapse