agentusecasesAll 965 use cases
Software & DevOps

Click through macOS app builds to catch visual bugs

A developer used Claude Code computer use to compile, launch, and click through macOS app screens to find layout bugs.

Done withClaude CodeClaude computer use

What they did
The built-in computer-use MCP server is enabled through /mcp, and macOS Accessibility and Screen Recording permissions are granted. The developer approves each app per session. Claude then runs xcodebuild, launches the app, clicks through windows, resizes them to reproduce layout problems, takes screenshots, and reads the code to suggest a fix.
How it went
The article describes the workflow but gives no measured results. It is a research preview, so behavior may change between versions.
Worth knowing
It needs a Pro or Max plan, Claude Code v2.1.85 or later, and macOS in an interactive session. It runs on your real desktop, so check manually anything where a wrong click could cause side effects.

Try it yourself with Claude Code

Compile and launch my macOS app in [project path]. Click through each screen, including [key screens or flows], and look for layout bugs like clipped text, overlapping views, or misaligned controls. Finish with a list of each bug, the screen it was on, and a suggested fix; don't change any code until I approve.

Read the original ↗

Source: claudcod.com · Undated

Five of these in your inbox every morning

The best things people got an AI agent to do, each with the prompt to try it.

More like this