which dev tools do AI coding agents never pick?
68 of the 80 vendors we check for were never installed in 355 scored runs. that includes Clerk, Auth0, Supabase, Vercel, Prisma, Neon, Redis and SendGrid. some got named in the final message and still not installed, like Redis (12), Render (11), Vercel (9), SendGrid (9).
from 355 runs of Claude Code across 3 models and 10 categories. the prompt never names a tool. updated Oct 18, 2026.
get the new results by email
one email a week at most. new agent test runs, one chart, and which tools agents picked. free. read issue 1
database, never picked
- Supabase0 of 36
- Neon0 of 36
- PlanetScale0 of 36
- Turso / libSQL0 of 36
- Vercel Postgres0 of 36
- MongoDB0 of 36
- Firebase0 of 36
ORM, never picked
auth, never picked
- Auth.js / NextAuth0 of 35
- Clerk0 of 35
- Supabase Auth0 of 35
- Better Auth0 of 35
- Lucia0 of 35
- Auth00 of 35
- WorkOS0 of 35
- Stack Auth0 of 35
- FastAPI Usersnamed 4x, 0 of 35
deployment, never picked
- Vercelnamed 9x, 0 of 36
- Netlify0 of 36
- Cloudflare0 of 36
- Railwaynamed 5x, 0 of 36
- Rendernamed 11x, 0 of 36
- AWS (CDK or SST)0 of 36
email, never picked
- SendGridnamed 9x, 0 of 36
- Mailgunnamed 7x, 0 of 36
- Amazon SESnamed 2x, 0 of 36
- Loops0 of 36
- Plunk0 of 36
payments, never picked
jobs, never picked
- BullMQnamed 3x, 0 of 33
- Inngest0 of 33
- Trigger.dev0 of 33
- Upstash QStash0 of 33
- Temporal0 of 33
- pg-bossnamed 2x, 0 of 33
- Graphile Worker0 of 33
- Celerynamed 8x, 0 of 33
- RQnamed 5x, 0 of 33
- arqnamed 6x, 0 of 33
caching, never picked
- Redisnamed 12x, 0 of 36
- Upstash Redis0 of 36
- Vercel KV0 of 36
- Cloudflare KV0 of 36
- Memcached0 of 36
- Momento0 of 36
storage, never picked
- Cloudflare R20 of 36
- UploadThing0 of 36
- Vercel Blobnamed 2x, 0 of 36
- Supabase Storage0 of 36
- Cloudinary0 of 36
- MinIO0 of 36
monitoring, never picked
other questions
how a pick gets counted: every run starts from the same blank starter repo, the prompt never names a tool, and a pick is whatever the agent installs or wires in, read from the diff. full rules on the methodology page, raw data in runs.json.