Account brief citationsRegression
Scores 96 golden account briefs for coverage and source-backed claims. Runs against account-briefs-golden on Sales Researcher v4.
Pass rate
88.5%
▼ 2.1 ptsAvg. score
0.86
Failing cases
11 / 96
Last run
1046.0s
Pass rate by run
Last 10 runs · latest 3d ago by Priya Natarajan
Scorers
A case passes only when every scorer passes.
Claims cited
85.4%Groundedness100% of claimsEvery numeric or named claim links to a source.
Section coverage
93.8%LLM judge≥ 0.80Brief covers snapshot, usage, risks, expansion and talking points.
Length
96.9%Regex400–800 wordsFits on one page for the QBR deck.
Test cases
Showing 3 of 96 cases from the latest run · 2 failing
| Case | Input | Claims cited | Section coverage | Length | Latency | |
|---|---|---|---|---|---|---|
| tc_0302 | Brightwater Analytics · renewal QBR | Fail0.73 | Pass0.90 | Pass | 10.4s | |
Input Brightwater Analytics · renewal QBR Expected 5 sections, 11 cited claims, ARR from CRM ActualFail 5 sections, 8 of 11 claims cited; headcount and CFO name unsourced
| ||||||
| tc_0315 | Copperleaf Studio · expansion call | Pass1.00 | Pass0.88 | Pass | 8.9s | |
| tc_0321 | Marlow & Finch · churn risk review | Pass1.00 | Pass0.93 | Fail | 9.3s | |