AI Rollback Runbook

AI Rollback

LLM systems can regress via prompt changes, routing changes, model updates, or data drift. This runbook prioritizes freezing change, verifying, rolling back, and learning.

Sections

Preflight & Freeze Verification on Test Set Rollback Steps Postmortem

Operational Scenarios (AI Rollback)

Cost Spike Runbook Privacy Incident Runbook Drift Monitoring Prompt Regression Model Routing

Articles

Why More Context Can Make AI Answers Worse

Why More Context Can Make AI Answers Worse

A larger context window does not guarantee a better answer. This article explains how signal dilution, conflicting evidence, stale state, position sensitivity, and lossy compression can reduce AI reliability—and introduces a practical Context Pressure Test.