Compare

A · run_cfa193vsB · run_a21691support-triageSwap A and B

Duration: 6.5s +18%; A: 5.5s
Cost: $0.025 +76%; A: $0.014
Tokens: 12.4k +49%; A: 8.4k
Steps: 4 -64%; A: 11
Model changed: Gemini 2.5 Pro; A: Claude Haiku

Steps, aligned

Change	Step	A	B
Slower	Input policy check	0.1s	0.2s
Slower	Plan the task	0.6s	2.1s
Slower	search_docs	0.3s	0.8s
Changed	Write final answer	0.4s	3.0s
Removed	Decide next step	0.7s	—
Removed	search_tickets	0.4s	—
Removed	search_docs	0.3s	—
Removed	Decide next step	0.7s	—
Removed	get_customer	0.5s	—
Removed	search_tickets	0.4s	—
Removed	Write final answer	0.8s	—

Output diff

− 0 words + 0 words 100% unchanged

Billing P1 The customer reports a duplicate charge on the March invoice and wants a refund today. #4822 and routed it to the billing queue, attached both payment ids and flagged it for same-day review.