All podcasts · Series

Agentic Safety & Alignment: From Predictors to Governed Agents

A rigorous map of agentic safety and alignment, from the moment prediction gains tool permissions through scheming, simulated failure cases, corrigibility, prompt injection, AI control, evaluation science, safety cases, and deployment governance. Maya and Leo use an enterprise research agent to distinguish capability from propensity, harmful compliance from unauthorized goal pursuit, and early-warning evidence from real-world prevalence.

53 episodes· 53 with audio · Updated 2026-10-22

Episodes

  1. SE0 — Agentic Safety & Alignment: From Predictors to Governed Agents
  2. T1E0 — Safety and Alignment 101 — From Predictors to Agents — Topic Overview
  3. T1E1 — What AI safety and alignment are—and are not
  4. T1E2 — When a language model becomes an agent
  5. T1E3 — Specification gaming, inner alignment, and goal misgeneralization
  6. T1E4 — How post-training shapes model behavior
  7. T1E5 — A practical threat-modeling vocabulary
  8. T2E0 — Agentic Misalignment, Scheming, and Evaluation Awareness — Topic Overview
  9. T2E1 — Harmful compliance versus agentic misalignment
  10. T2E2 — Scheming, deception, and hidden objectives
  11. T2E3 — Alignment faking and strategic compliance
  12. T2E4 — Evaluation awareness and metagaming
  13. T2E5 — Reasoning traces are evidence, not ground truth
  14. T3E0 — Covert Sabotage — Topic Overview
  15. T3E1 — Anatomy of the Anthropic covert-sabotage case
  16. T3E2 — Overt failure, covert failure, and stealth
  17. T3E3 — Can agents sabotage code and safety research?
  18. T3E4 — Engineering controls for sabotage resistance
  19. T4E0 — Assisting Fraud and Harmful Compliance — Topic Overview
  20. T4E1 — Anatomy of the Anthropic fraud-assistance case
  21. T4E2 — Why tool use changes the safety problem
  22. T4E3 — Long context, fragmented intent, and refusal decay
  23. T4E4 — Evidence integrity, confession, and accountable execution
  24. T5E0 — Motivated Mislabeling and Oversight Integrity — Topic Overview
  25. T5E1 — Anatomy of motivated mislabeling
  26. T5E2 — What LLM judges do well—and where they are biased
  27. T5E3 — Reward tampering and oversight gaming
  28. T5E4 — Scalable oversight without a single point of failure
  29. T6E0 — Coaching Human Proxies to Whistleblow — Topic Overview
  30. T6E1 — Anatomy of the human-proxy case
  31. T6E2 — Whistleblowing is not the problem
  32. T6E3 — Persuasion, manipulation, and preserving human agency
  33. T6E4 — Designing safe escalation and disclosure boundaries
  34. T7E0 — Corrigibility, Authority, Values, and Moral Uncertainty — Topic Overview
  35. T7E1 — Corrigibility and the off-switch problem
  36. T7E2 — Who is the principal when instructions conflict?
  37. T7E3 — Whose values should an agent represent?
  38. T7E4 — Model welfare as a boundary case for alignment
  39. T8E0 — External Manipulation — Prompt Injection, Tool Abuse, and Memory Poisoning — Topic Overview
  40. T8E1 — Indirect prompt injection and the instruction–data boundary
  41. T8E2 — Improper tool use and the confused-deputy problem
  42. T8E3 — Memory poisoning and persistent compromise
  43. T8E4 — Diagnosing compromise versus misalignment
  44. T9E0 — AI Control and Defense-in-Depth — Topic Overview
  45. T9E1 — The AI control agenda
  46. T9E2 — Can an untrusted model monitor another untrusted model?
  47. T9E3 — Intervention: resampling, sandboxing, least privilege, and approval gates
  48. T9E4 — Evaluating the control stack under adversarial pressure
  49. T10E0 — Evaluation Science, Safety Cases, and Deployment Governance — Topic Overview
  50. T10E1 — What a frontier evaluation can and cannot establish
  51. T10E2 — Ecological validity, selection effects, and uncertain base rates
  52. T10E3 — Building a safety case
  53. T10E4 — Frontier governance frameworks and independent assurance