Compare

A · run_3fd0bevsB · run_f334a8support-triageSwap A and B

Duration: 3.5s -94%; A: 1m 3s
Cost: $0.045 +51%; A: $0.030
Tokens: 26.9k +3%; A: 26.1k
Steps: 10 0%; A: 10
Model changed: Gemini 2.5 Pro; A: Claude Haiku

Steps, aligned

Change	Step	A	B
Faster	Input policy check	0.7s	0.0s
Faster	Plan the task	10.6s	0.7s
Faster	search_docs	5.0s	0.3s
Faster	Retrieve context · top 8	2.5s	0.1s
Faster	Decide next step	9.3s	0.6s
Faster	search_tickets	5.2s	0.3s
Faster	search_docs	1.7s	0.3s
Faster	Decide next step	8.6s	0.4s
Faster	get_customer	3.6s	0.2s
Faster	Write final answer	11.8s	0.4s

Output diff

− 0 words + 0 words 100% unchanged

Billing P2 The customer reports a duplicate charge on the March invoice and wants a refund today. #4821 and routed it to the billing queue, attached both payment ids and flagged it for same-day review.