Test how well coding agents can onboard to your product
ax-check.com runs coding agents in sandboxes to try onboarding to a product, then returns a scorecard, suggested fixes, and full session traces.
Done with a custom-built or unnamed agent
- What they did
- You enter your product's site on AX Check, which first checks the site itself. Three coding agents then try to onboard end to end in sandboxes. The service returns concrete guidance on what to fix in your docs, marketing site, CLI, MCP, or Skills, and shows the real agent sessions.
- How it went
- Results appear as scores out of 100 with a letter grade and a leaderboard. Examples include oleander at 100, Moderne at 65 (missing llms.txt) and Strapi at 65 (agents guessed at pricing).
Try it yourself with Claude Code
Act as a new developer trying to onboard to [my product or API] using only its public docs at [docs URL]. Try to complete the quickstart in a fresh temporary folder, recording every step, error, and point where you got stuck. Finish with a scorecard out of 10, a list of the top five doc or setup fixes, and a log of what you tried. Do not use any real credentials without asking me first.
Discussion on HN · Sep 17, 2026
Five of these in your inbox every morning
The best things people got an AI agent to do, each with the prompt to try it.
More like this
- Claude
Build a C compiler with a team of parallel agents
Anthropic's engineering write-up on tasking Opus 4.6 agent teams with building a C compiler.
- Custom agent
Catch cloud outage risks before they happen
An autonomous ReAct agent that queries real data to stop cloud outages before they occur, built for the Sanity Challenge.
Hand narrow code changes to Devin for pull requests
A team used Devin for a month on small fixes like chart formatting and API edge cases, with tests and PRs; a complex full-stack task went poorly.
Migrate toolchain, architecture and site design with Claude Code
A developer had Claude Code switch a monorepo to oxlint/oxfmt, restructure the architecture and redesign a site, validating in a loop; the redesign took days instead of weeks.
Build and deploy a Game of Life simulation site
In a vendor launch demo, Devin built an interactive Game of Life website, added requested features step by step, and deployed it to Netlify.
Resolve a Slack-reported issue with a coding agent
A Codex agent resolved an issue passed to it in about 40 minutes, and an ops agent verified the fix back in Slack.