AI Universitythe atlas of intelligence

← All courses

AI Safety & Alignment

Why keeping capable AI reliably doing what we intend is hard — and the techniques used today.

beginner · 45 minutes

A grounded introduction to **AI safety and alignment**: what it means to get AI systems to reliably do what we intend, and why that turns out to be hard. We cover how today's language models are actually aligned (SFT, RLHF, constitutional methods, red-teaming, and evals), where those methods fall short, and how to reason about risks without hype. By the end you'll be able to spot reward hacking, tell near-term harms from speculative ones, and explain why oversight and evaluation remain open problems.

What you'll learn

  1. What "Alignment" Actually Means
  2. The Specification Problem and Reward Hacking
  3. Outer and Inner Alignment
  4. How Today's Systems Are Aligned
  5. Robustness, Jailbreaks, and Interpretability
  6. Risks, Oversight, and What's Unsolved

Start learning