# What is observability, and how is it different from monitoring?

Monitoring tells you something is wrong. Observability lets you work out why without reproducing it. The practical test is a question: when a customer says last Tuesday's run was wrong, can you answer from what the system already recorded, or do you have to run it again and hope it misbehaves the same way?

Also called: monitoring, alerting
Checked: 2026-09-27

In one line

Answering why, from what was already recorded.

## Why it matters to you

For an AI system this is harder than for ordinary code, because the interesting failures do not throw. A step that returns an empty result, a provider that answers 200 with a rate-limit body, a model that answers confidently and wrongly: none of those raise an error, so a dashboard of error counts shows nothing at all.

What works is picking one number per pipeline that only moves when the pipeline is healthy, and reading it on a schedule. On the WhoFits lead engine that number is the yield rate, the share of enriched leads that turn up a website, because a silently blocked search engine returns an empty result with no error at all.

The other half is splitting surfaces by what each can see. Mooney sends errors to five places because each one sees something the others cannot, and a decision table names which to open first per symptom. After every release a smoke test fires a deliberate crash to confirm the pipeline still works, because monitoring that is never tested dies quietly.

## Where it turns up in something we run

- Five error surfaces split by what each can see, with a decision table naming which to open first per symptom (recorded 2026-09-14, [Mooney](https://octyn.co/casestudies/mooney))
- No uptime monitor and no alerting on the WhoFits crawler, which is a batch system checked by a person running a status command (recorded 2026-09-14, [WhoFits](https://octyn.co/casestudies/whofits))

## Next to this

- [Rollback](https://octyn.co/glossary/rollback)
- [p95 latency](https://octyn.co/glossary/p95-latency)
- [Dry run](https://octyn.co/glossary/dry-run)

## Argued out at length

- [Why your AI automation broke and nobody noticed](https://octyn.co/compare/ai-automation-failing-silently)
- [What production ready means for an AI system](https://octyn.co/compare/production-ready-ai-system)

## Related

- [Why your AI automation broke and nobody noticed](https://octyn.co/compare/ai-automation-failing-silently)
- [Rollback](https://octyn.co/glossary/rollback)
- [The Consult](https://octyn.co/consult)

Canonical: https://octyn.co/glossary/observability