Control a computer with Claude's mouse and keyboard
A poster tested Claude computer use for a day, where it screenshots, infers the screen, then moves the mouse and types; multi-app drift and small UI misses remained problems. ·
Done withClaude computer use
- What they did
- The poster spent a day testing Claude’s Computer Use on a Mac, where Claude repeatedly took screenshots, inferred the UI, then clicked and typed to complete tasks. They had it rename and sort 40+ files, copy PDF data into a Numbers spreadsheet, fill the same browser form eight times, and compile notes from five tabs, stepping in when it lost track of windows or needed a correction.
- How it went
- It got all 40+ file actions right in about five minutes and was described as slow but accurate on data entry; the form-filling test had one date-format mistake. The poster estimated about 80% reliability on simple tasks and 50% on complex ones, with silent failures in longer multi-app workflows and no good handling of captchas, 2FA, speed-sensitive tasks, or risky clicks.
- Worth knowing
- The main catch was that it took over the whole Mac while running, so the poster saw the best use case as starting a task and walking away.
Try it yourself with Claude computer use
Use my desktop to do this task: [describe a short task, e.g. copy the figures from a spreadsheet into a form in another app]. Take a screenshot after each step to confirm it worked, and tell me if something doesn't look as expected instead of guessing. Pause and show me what you're about to do before submitting, sending, or deleting anything; you're done when [the finished result] is on screen.
Want help getting this working? Join the Vibe Coding Academy ↗ Run by Alex Finn, who also runs this site.
Source: Reddit · Mar 30, 2025
Related use cases
Fill out a Form 1040 with computer use
A tester gave Claude Computer Use data stored on disk and checked whether it could find the fields and fill a simplified Form 1040 accurately.
Research a blog post with Claude computer use
The author used Claude computer use with Claude in Chrome to research the post itself, suggesting starting with a logged-in site and a specific lookup.
Apply to 50 jobs in under 30 minutes
Claude computer use submitted 50 job applications in under 30 minutes, shown in a video demo.
Run a solo company with eight agent departments
A founder set up CEO, CFO, COO, lawyer, accountant, marketing, CTO, and improver agents that share memory and consult each other.
Create bills in QuickBooks from supplier invoices
A commenter uses an AI agent connected to QuickBooks Online, email and Drive to check the books and turn supplier invoices into bills.
Custom agent
Email daily ClickUp digests to stakeholders
A Make.com scenario sends a daily email digest from ClickUp to stakeholders without ClickUp accounts, and adds contacts to a selected action item.
Get 5 like this every morning
The best things people got an AI agent to do, each with the prompt to try it.