Let a benchmark referee the agent's performance fix

Mon, 02 Nov 2026 07:13:00 +0000

A customer-reconciliation job takes 130 ms on 20,000 order lines, and the ticket says “make it faster”. Ask an agent and it comes back with a diff that looks plausible: the regex is hoisted, a list becomes a hash set, maybe there’s a Parallel in there for good measure. The tests pass. Whether it’s faster, and by how much, and at what cost in allocations, is left to the reviewer’s gut.

Benchmarkdotnet on Tokenise

Let a benchmark referee the agent's performance fix