Alerts
Threshold rules on error rate, latency, cost and evals, routed to your team's channels.
3 firing · 0 acknowledged
CriticalFiringalt_2041 · triggered 38m ago
Error rate above 25%
Contract Analyst has failed 61 of 214 runs since deploy v31. Most failures are pdf.read timeouts on scanned files.
- Agent
- Contract Analyst
- Rule
- error rate > 5% for 10m
- Value
- 28.7%
WarningFiringalt_2039 · triggered 2h ago
Monthly budget at 82%
Workspace spend reached $2,050 of the $2,500 October budget. At the current rate the cap is hit on Oct 21.
- Agent
- All agents
- Rule
- budget used > 80%
- Value
- 82%
WarningFiringalt_2036 · triggered 1h ago
p95 latency above SLO
Sales Researcher p95 latency has been over 10s for 25 minutes, driven by slow web.fetch calls.
- Agent
- Sales Researcher
- Rule
- p95 latency > 10s for 15m
- Value
- 11.2s
| Alert | Severity | Agent | Triggered | Resolved | Resolved by |
|---|---|---|---|---|---|
Queue depth above 100queue depth > 100 for 5m | Warning | Support Triage | Today, 09:12 | Today, 09:31 | Auto-resolved |
Webhook delivery failingwebhook failures > 20 in 5m | Critical | Invoice Reconciler | Oct 13, 22:40 | Oct 13, 22:54 | Daniel Reyes |
Eval score droppedeval score drop > 2 pts | Info | Onboarding Guide | Oct 12, 03:05 | Oct 12, 11:20 | Mira Kowalski |
Token usage spiketokens per run > 3× baseline | Warning | Sales Researcher | Oct 10, 15:47 | Oct 10, 16:30 | Priya Natarajan |
6 of 7 rules enabled
| Rule | Condition | Severity | Channels | Enabled |
|---|---|---|---|---|
High error rateAll live agents | error rate > 5% for 10m | Critical | On-call pager#agent-alerts | |
Latency SLOAll live agents | p95 latency > 10s for 15m | Warning | #agent-alerts | |
Budget thresholdWorkspace | budget used > 80% | Warning | Email#finance-ops | |
Eval regressionSupport Triage, Onboarding Guide | eval score drop > 2 pts | Info | #ml-quality | |
Queue backlogSupport Triage | queue depth > 100 for 5m | Warning | #agent-alerts | |
Webhook failuresWorkspace | webhook failures > 20 in 5m | Critical | On-call pager | |
Token spikeAll live agents | tokens per run > 3× baseline | Warning | Email |