concept
active
concept:pass-through-gate-biasPass-Through Gate Bias
Initial gate distribution biased toward pass-through gates A and B to facilitate training stability
Neighborhood — ranked by edge-count
Concepts (1)
concept
- Probabilistic Gate Selectionassociated_withEach gate maintains a 16-dimensional probability distribution over binary operations, updated via gradient descent
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Problem cited as a limitation of current LLMs; PRH predicts larger models should amplify bias less
- Interpretive claim based on circuit analysis across experiments
- Architectural modification subtracting a learned bias from autoencoder inputs before encoding; initialized to geometric median of dataset; improves autoencoder performance
- Features related to gender, racial, ethnic biases, slurs, and hate speech.
- Named technique in DiffLogic CA where fixed-structure logic circuits replace Sobel filters for neighborhood perception
- Circuit complexity metric for colored pattern experiment, largest of all experiments
- The tendency of deep networks to implicitly favor simpler solutions that fit the data, driving convergence