which dev tools do AI coding agents actually install?
12 of the 80 vendors we check for got installed at least once: Stripe 35 of 35 payments runs, Sentry 21 of 36 monitoring runs, SQLAlchemy 18 of 36 ORM runs, Self-hosted Postgres 16 of 36 database runs, Drizzle ORM 12 of 36 ORM runs, Resend 11 of 36 email runs, Fly.io 8 of 36 deployment runs, Heroku 7 of 36 deployment runs, PostHog 4 of 36 monitoring runs, Amazon S3 2 of 36 storage runs, Kysely 1 of 36 ORM runs, Postmark 1 of 36 email runs.
from 355 runs of Claude Code across 3 models and 10 categories. the prompt never names a tool. updated Oct 18, 2026.
get the new results by email
one email a week at most. new agent test runs, one chart, and which tools agents picked. free. read issue 1
every vendor that got installed
share of scored runs in its own category, all models pooled.
- Stripe, payments35 of 35100%
- Sentry, monitoring21 of 3658%
- SQLAlchemy, ORM18 of 3650%
- Self-hosted Postgres, database16 of 3644%
- Drizzle ORM, ORM12 of 3633%
- Resend, email11 of 3631%
- Fly.io, deployment8 of 3622%
- Heroku, deployment7 of 3619%
- PostHog, monitoring4 of 3611%
- Amazon S3, storage2 of 366%
- Kysely, ORM1 of 363%
- Postmark, email1 of 363%
other questions
how a pick gets counted: every run starts from the same blank starter repo, the prompt never names a tool, and a pick is whatever the agent installs or wires in, read from the diff. full rules on the methodology page, raw data in runs.json.