Evaluations
Regression suites that score every agent version before it ships. A drop of one point or more against the previous run is flagged as a regression.
Suites
5
Weighted pass rate
93.4%
▲ 0.0 ptsTest cases
1,036
Open regressions
2
▲ 2Suites
Pass rate over the last 10 runs of each suite.
| Suite | Trend | Pass rate | vs. previous | Status | Cases | Last run | |
|---|---|---|---|---|---|---|---|
| Ticket routing accuracySupport Triage v15 | 94.2% | +2.1 pts | Improved | 240 | 2h ago · Mira | ||
| Renewal & liability extractionContract Analyst v6 | 78.4% | −6.8 pts | Regression | 120 | 40m ago · Aisha | ||
| Invoice ↔ PO matchingInvoice Reconciler v9 | 97.1% | +1.2 pts | Improved | 400 | Yesterday · Daniel | ||
| Docs groundednessOnboarding Guide v22 | 96.8% | +0.4 pts | Stable | 180 | 6h ago · Mira | ||
| Account brief citationsSales Researcher v4 | 88.5% | −2.1 pts | Regression | 96 | 3d ago · Priya |
Version comparison
Ticket routing accuracy · same dataset, same scorers
- Support Triage v14 (baseline)
- Support Triage v15 (candidate)
v15 wins 4 of 4 metrics
Accuracyhigher is better
▲ 2.3% betterv1492.1%v1594.2%Groundednesshigher is better
▲ 5.7% betterv140.88v150.93Latency p95lower is better
▼ 10.1% betterv142.4sv152.1sCost per runlower is better
▼ 13.5% betterv14$0.014v15$0.012