Compare

A · run_a21691vsB · run_cfa193support-triageSwap A and B

Duration: 5.5s -15%; A: 6.5s
Cost: $0.014 -43%; A: $0.025
Tokens: 8.4k -33%; A: 12.4k
Steps: 11 +175%; A: 4
Model changed: Claude Haiku; A: Gemini 2.5 Pro

Steps, aligned

Change	Step	A	B
Faster	Input policy check	0.2s	0.1s
Faster	Plan the task	2.1s	0.6s
Faster	search_docs	0.8s	0.3s
Changed	Retrieve context · top 8	3.0s	0.4s
Added	Decide next step	—	0.7s
Added	search_tickets	—	0.4s
Added	search_docs	—	0.3s
Added	Decide next step	—	0.7s
Added	get_customer	—	0.5s
Added	search_tickets	—	0.4s
Added	Write final answer	—	0.8s

Output diff

− 0 words + 0 words 100% unchanged

Billing P1 The customer reports a duplicate charge on the March invoice and wants a refund today. #4822 and routed it to the billing queue, attached both payment ids and flagged it for same-day review.