Compare
A · run_d76fabvsB · run_560b64support-triageSwap A and B- Duration
- 26.4s -54%
- A: 57.1s
- Cost
- $0.039 -22%
- A: $0.050
- Tokens
- 13.5k -11%
- A: 15.2k
- Steps
- 4 0%
- A: 4
- Model changed
- GPT-4.1
- A: Gemini 2.5 Pro
Steps, aligned
| Change | Step | A | B |
|---|---|---|---|
| Faster | Input policy check | 1.5s | 0.6s |
| Faster | Plan the task | 22.1s | 9.1s |
| Faster | search_docs | 9.2s | 4.7s |
| Changed | Retrieve context · top 8 | 20.8s | 4.2s |
Output diff
− 35 words + 2 words 0% unchangedBilling P2 The customer reports a duplicate charge on the March invoice and wants a refund today. #4821 and routed it to the billing queue, attached both payment ids and flagged it for same-day review.(no output)