Intent based chaos testing spots when AI acts confidently yet wrong, including outages caused by missing context

A rollback bot acted on confidence from incomplete context

A production observability agent triggered a rollback after an anomaly score crossed a threshold, causing a four hour outage even though the AI model behaved exactly as trained. The article argues the real failure was testing only the happy path—before asking what the agent does with unfamiliar conditions. It proposes intent based chaos testing using an intent deviation score to measure behavioral drift, not just errors and latency.