AI Rollback Runbook

AI Rollback

LLM systems can regress via prompt changes, routing changes, model updates, or data drift. This runbook prioritizes freezing change, verifying, rolling back, and learning.

Sections

Preflight & Freeze Verification on Test Set Rollback Steps Postmortem

Operational Scenarios (AI Rollback)

Cost Spike Runbook Privacy Incident Runbook Drift Monitoring Prompt Regression Model Routing

Articles