method
active
method:logit-bias-constraintLogit Bias Constraint
Used with GPT models to constrain responses to binary options (0/1) in belief coherence experiments.
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Problem cited as a limitation of current LLMs; PRH predicts larger models should amplify bias less
- Features related to gender, racial, ethnic biases, slurs, and hate speech.
- Early stopping in alpha sweeps when mean fluency falls below 95% of baseline or >5% of responses fall below 90% baseline
- Assumptions or preferences (e.g., parsimony) that determine how a learning system generalizes beyond training data
- Logistic regression trained on GSM8k training set to predict answer correctness from projection features along reflection direction
- Primary self-report measure: probability-weighted expected value over all ten digit-token logits, yielding a continuous rating that preserves full distributional signal
- Computing each feature's linear effect on output token logits via path expansion through MLP output weights and unembedding matrix
- Implementation technique zeroing all logits except Yes/No tokens to convert steering into binary cross-entropy