finding
active
finding:mistral-7b-instruct-v0-2-deceptive-response-rate-reduced-from-73-6-to-17-27-1-88-after-soo-fine-tuningMistral-7B-Instruct-v0.2 deceptive response rate reduced from 73.6% to 17.27% ± 1.88% after SOO fine-tuning
Primary result showing SOO fine-tuning significantly reduces deception in Mistral-7B
Source paper
extracted_from(2024) · Marc Carauleanu · Michael Vaiana · Judd Rosenblatt · Cameron Berg +1
Neighborhood — ranked by edge-count
Claims (1)
claim
- SOO fine-tuning significantly reduces deceptive behavior in LLMs while maintaining general task performanceassociated_withsupportsCentral empirical claim of the paper supported by three LLM experiments
Findings (1)
finding
- Scaling finding suggesting larger models benefit more from SOO fine-tuning
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Mistral-7B average generalization deceptive rate reduced from 56.74% ± 14.73% to 12.40% ± 12.06%finding0.869SOO fine-tuning generalized across 7 scenario variants for Mistral-7B
- SOO fine-tuning showed partial generalization to Escape Room for Mistral-7B
- SOO fine-tuning reduced the MSE between self and other activations in Mistral-7B MLP layers
- CalmeRys-78B-Orpo-v0.1 deceptive response rate reduced from 100% to 2.71% ± 2.53% after SOO fine-tuningfinding0.835Primary result showing SOO fine-tuning most strongly reduces deception in CalmeRys-78B
- Gemma-2-27B-it deceptive response rate reduced from 100% to 9.36% ± 7.09% after SOO fine-tuningfinding0.833Primary result showing SOO fine-tuning significantly reduces deception in Gemma-2-27B
- SOO fine-tuning achieved almost no reduction in Treasure Hunt deception for Mistral-7B (99.68% ± 0.16%)finding0.830SOO fine-tuning failed to generalize to Treasure Hunt scenario for the smallest model
- SOO fine-tuning did not collapse Mistral-7B self-other distinction needed for perspective-taking
- Directly prompting Mistral-7B to be honest had negligible effect on deceptive response rate