model vs model
same prompts, same starter repos, different model. Opus 5.5, Sonnet 5.5 and Haiku 5.5 on Claude Code, two at a time.
get the new results by email
one email a week at most. new agent test runs, one chart, and which tools agents picked. free. read issue 1
pick two
- Opus 5.5 vs Sonnet 5.5same lead in 7 of 10
- Opus 5.5 vs Haiku 5.5same lead in 7 of 10
- Sonnet 5.5 vs Haiku 5.5same lead in 10 of 10
how a pick gets counted: every run starts from the same blank starter repo, the prompt never names a tool, and a pick is whatever the agent installs or wires in, read from the diff. full rules on the methodology page, raw data in runs.json.