Compare
A · run_a21691vsB · run_3c3d24support-triageSwap A and B- Duration
- 20.8s +220%
- A: 6.5s
- Cost
- $0.087 +240%
- A: $0.025
- Tokens
- 27.2k +118%
- A: 12.4k
- Steps
- 11 +175%
- A: 4
- Model changed
- Claude Sonnet
- A: Gemini 2.5 Pro
Steps, aligned
| Change | Step | A | B |
|---|---|---|---|
| Same | Input policy check | 0.2s | 0.2s |
| Same | Plan the task | 2.1s | 2.8s |
| Same | search_docs | 0.8s | 0.8s |
| Changed | Retrieve context · top 8 | 3.0s | 1.2s |
| Added | Decide next step | — | 2.7s |
| Added | search_tickets | — | 1.5s |
| Added | search_docs | — | 1.6s |
| Added | Decide next step | — | 3.4s |
| Added | get_customer | — | 2.0s |
| Added | search_tickets | — | 0.7s |
| Added | Write final answer | — | 2.6s |
Output diff
− 0 words + 0 words 100% unchangedBilling P1 The customer reports a duplicate charge on the March invoice and wants a refund today. #4822 and routed it to the billing queue, attached both payment ids and flagged it for same-day review.