Evals Catch Known Unknowns. Production Catches Unknown Unknowns.

Evals are necessary, but they only test the failures you already know to look for. The failures that hurt retention, conversion, and trust usually show up first in production conversation data.