finding
active
finding:few-shot-prompting-had-a-negative-effect-on-hh-intent-for-smaller-models-and-a-significant-positive-impact-on-larger-modelsFew-shot prompting had a negative effect on HH-intent for smaller models and a significant positive impact on larger models.
Ablation result from Experiment 3 on few-shot prompting effects.
Source paper
extracted_from(2024) · Francis Rhys Ward · Zejia Yang · Alex Jackson · Randy A. Brown +6
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Ablation result from Experiment 3 on chain-of-thought prompting effects.
- Evidence for two representational pathways based on cross-method activation divergence
- Main result from Experiment 3 on HH-intent scaling with model size.
- Unexpected finding that behavioral baseline underperforms representational probing approaches
- Providing k labeled examples in the prompt to steer model behavior.
- Main result from Experiment 3 on effect of fine-tuning on HH-intent.
- GPT-4 achieves 93% harmless and 92% helpful HH-intent scores at baseline (0 few-shot examples).finding0.742Numerical result from Table 3 for GPT-4.
- Control finding bounding interpretation of FS vs SP difference