Compare

A · run_676fafvsB · run_06a024support-triageSwap A and B

Duration: 1m 24s -9%; A: 1m 33s
Cost: $0.015 -43%; A: $0.025
Tokens: 9.7k +1%; A: 9.6k
Steps: 11 +120%; A: 5
Model changed: Claude Haiku; A: GPT-4.1

Steps, aligned

Change	Step	A	B
Faster	Input policy check	2.3s	0.9s
Faster	Plan the task	25.1s	9.0s
Faster	search_docs	16.5s	2.7s
Faster	Retrieve context · top 8	11.0s	6.1s
Changed	Decide next step	32.0s	13.2s
Added	search_tickets	—	4.4s
Added	search_docs	—	6.8s
Added	Decide next step	—	13.3s
Added	get_customer	—	5.1s
Added	search_tickets	—	4.0s
Added	Write final answer	—	13.3s

Output diff

− 0 words + 0 words 100% unchanged

Billing P1 The customer reports a duplicate charge on the March invoice and wants a refund today. #4822 and routed it to the billing queue, attached both payment ids and flagged it for same-day review.