That 2-point benchmark lead might just be a bigger server

Sat, 03 Oct 2026 12:00:00 +0000

Every model launch comes with a table of coding benchmark scores, and the gaps are often a few points. Anthropic’s engineering team published a study that should make you read those gaps more carefully. In its infrastructure noise analysis , it found that how much compute an eval runs on can move agentic coding scores by more than the leaderboard gap between top models.

Terminal-Bench on Tokenise

That 2-point benchmark lead might just be a bigger server