Let Claude drive a Mac to play chess and make notes
A writer gave Claude computer use control of his Mac to play chess and create notes; simple tasks worked, complex ones failed, and usage quota nearly ran out.
Done withClaude
- What they did
- Ben Patterson turned on computer use in Claude's settings on a Mac mini and granted accessibility and screen recording permissions. He also had to approve each app individually. Claude opened Notes and wrote a note, and it added a lasagna shopping list when asked from his iPhone through Dispatch. He then asked it to play Chess.
- How it went
- The Notes tasks worked. Claude got stuck trying to move a single chess piece on the 3D board. Those failed attempts used up nearly his whole five-hour Claude Pro allotment in about 30 minutes, so he stopped it.
- Worth knowing
- Computer use sends screenshots of your whole screen to Claude and burns usage quickly on a Pro plan, so keep sensitive windows closed and stick to simple tasks.
Try it yourself with Claude
Take control of my computer and open [chess app or website]. Play a game against the built-in [easy/medium] computer opponent, then open [notes app] and write a short note summarizing how the game went. Keep to these two simple steps, tell me if something fails instead of retrying endlessly, and stop once the note is saved.
Want help getting this working? Join the Vibe Coding Academy ↗ Run by Alex Finn, who also runs this site.
Source: pcworld.com · Undated
Related use cases
Build a C compiler with a team of parallel agents
Anthropic's engineering write-up on tasking Opus 4.6 agent teams with building a C compiler.
Schedule social videos and posts through an agent
Users relay that their AI agent installed a scheduling skill, linked social accounts and scheduled about 100 videos; these are vendor-relayed testimonials.
Consolidate bank statements into a spending dashboard with Claude
Miles Deutscher reportedly uses Claude to merge monthly bank statements into a dashboard, visualize spending, compute metrics and analyze portfolio allocation.
Get a second opinion on an MRI
One person's account of using Claude Code to analyze their own MRI.
Run life admin and to-dos from Claude Code
A new mom and entrepreneur uses Claude Code to capture to-dos, break overwhelming tasks into 10-minute first steps, and learn her preferences into a file.
Clean inbox, chase refund, and book HVAC tune-up
Meta Muse deleted 20k+ old Hotmail emails, chased a missing refund via ISP support chat, and scheduled an HVAC tune-up from maintenance history.
Get 5 like this every morning
The best things people got an AI agent to do, each with the prompt to try it.