paper
referenced-only
2024
paper:doi-10-48550-arxiv-2404-09932Foundational Challenges in Assuring Alignment and Safety of Large Language Models
ByUsman Anwar·Abulhair Saparov·Javier Rando·Daniel Paleka·Miles Turpin·Peter Hase+4 more
Original abstract (expand)
This work identifies 18 foundational challenges in assuring the alignment and safety of large language models (LLMs). These challenges are organized into three different categories: scientific understanding of LLMs, development and deployment methods, and sociotechnical challenges. Based on the identified challenges, we pose $200+$ concrete research questions.
Similar preprints — Semantic Scholar
Cited by (1)
- Belief Dynamics Reveal the Dual Nature of In-Context Learning and Activation Steering
In-context learning and activation steering are the same operation on a latent-concept belief: context adds log-likelihood evidence while a steering vector adds a constant shift to the log prior odds,