Confidence Thresholds for Model Escalation Routing

Confidence-based escalation keeps most requests on a cheap model and sends only the ones it is unsure about to a stronger one. This guide covers forcing a numeric confidence field with structured outputs, setting the threshold from error rates on your own traffic, tuning it against accuracy, cost,…