Compare

A · run_b0e47bvsB · run_3fd0besupport-triageSwap A and B

Duration: 1m 3s +1234%; A: 4.7s
Cost: $0.030 -27%; A: $0.041
Tokens: 26.1k +122%; A: 11.7k
Steps: 10 +25%; A: 8
Model changed: Claude Haiku; A: Gemini 2.5 Pro

Steps, aligned

Change	Step	A	B
Slower	Input policy check	0.1s	0.7s
Slower	Plan the task	0.9s	10.6s
Slower	search_docs	0.5s	5.0s
Slower	Retrieve context · top 8	0.3s	2.5s
Slower	Decide next step	0.8s	9.3s
Slower	search_tickets	0.7s	5.2s
Slower	search_docs	0.4s	1.7s
Changed	Decide next step	0.8s	8.6s
Added	get_customer	—	3.6s
Added	Write final answer	—	11.8s

Output diff

− 0 words + 0 words 100% unchanged

Billing P2 The customer reports a duplicate charge on the March invoice and wants a refund today. #4821 and routed it to the billing queue, attached both payment ids and flagged it for same-day review.