question
active
question:what-are-the-long-term-effects-of-soo-fine-tuning-on-model-behaviorWhat are the long-term effects of SOO fine-tuning on model behavior?
Open research question identified as warranting further investigation
Source paper
extracted_from(2024) · Marc Carauleanu · Michael Vaiana · Judd Rosenblatt · Cameron Berg +1
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Central empirical claim of the paper supported by three LLM experiments
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- To what extent does self-deception in AI models affect the effectiveness of SOO fine-tuning?question0.803Open concern about whether models can learn to self-deceive in ways that undermine SOO
- Future work hypothesis about extending SOO to direct value alignment
- Key interpretive conclusion from the dissociation between attempt rate and improvement rate in fine-tuning experiments
- Scaling pattern: 78B > 27B > 7B in deception reduction from SOO fine-tuning
- Forward-looking claim about architectural generalizability of SOO
- Claim supported by Perspectives scenario results showing near-100% accuracy post-fine-tuning
- SOO fine-tuning may provide robustness against sleeper agent deception scenarios where intent is concealed over extended periodshypothesis0.779Future work hypothesis about testing SOO against adversarial sleeper agent scenarios
- What unintended consequences might SOO fine-tuning produce in complex or real-world applications?question0.768Open research question about potential negative side effects of SOO