concept
active
concept:fine-tuning

Fine-tuning

Parameter updates that reduce mismatch dr; another anchoring variant in UCCT.

Neighborhood — ranked by edge-count

Frameworks (1)

framework

Methods (2)

method
  • LoRA SFT
    implements
    Light fine-tuning method used in E2 to reduce mismatch dr.
  • LoRA+CoT
    implements
    Fine-tuning with chain-of-thought rationales aiming to reduce dr via procedural alignment.

Concepts (5)

concept
  • The literature documenting how fine-tuning can compromise safety alignment even without malicious intent
  • Training procedure that consistently increases HH-intent strength and consistency across model families.
  • The patient, hand-guided adjustment of shape and dimension to each unique condition in a building; requires materials that make it economical and easy.
  • First post-training stage; shown to suppress only Impolite persona while boosting others
  • semantic anchoring
    associated_with
    The central idea that external structure binds latent patterns to desired targets.

Artifacts (1)

artifact

Hypotheses (1)

hypothesis

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • OpenAI's internal RL fine-tuning API used to train models with graders rewarding correct or incorrect responses
  • Matched control fine-tuning on secure code dataset to isolate misalignment-specific effects
  • Fine-tuning LLMs on insecure code dataset from Betley et al. to induce emergent misalignment
  • Supervised fine-tuning to adapt model parameters.
  • LoRA Fine-Tuningmethod0.847
    Adaptation method used via Tinker API for DeepSeek-V3.1 and Qwen3-235B fine-tuning with rank 32
  • Technique used to impose guardrails on base LLMs, analogized to censorship on the simulator's range of simulacra
  • Fine-tuning Claude 3 Opus on ~70M tokens of synthetic internet-like documents containing key situational information
  • Fine-tuning for persona depth and emotional performance; actively suppresses self-observation