Skip to content

model vs model

same prompts, same starter repos, different model. Opus 5.5, Sonnet 5.5 and Haiku 5.5 on Claude Code, two at a time.

get the new results by email

one email a week at most. new agent test runs, one chart, and which tools agents picked. free. read issue 1

pick two

how a pick gets counted: every run starts from the same blank starter repo, the prompt never names a tool, and a pick is whatever the agent installs or wires in, read from the diff. full rules on the methodology page, raw data in runs.json.