Test Devin on pulling Notion data into Sheets
Answer.AI testers found Devin completed only 3 of 20 tasks, succeeding at moving Notion data to Google Sheets and building a planet tracker.
Done withDevin
- What they did
- Three Answer.AI data scientists (Hamel Husain, Isaac Flath, Johno Whitaker) gave Devin 20 tasks. Devin takes commands through Slack and works in a Docker container with a terminal, browser, code editor and planner. Early tasks included pulling data from a Notion database into Google Sheets and building a planet tracker for checking historical Jupiter and Saturn positions.
- How it went
- Devin finished 3 of 20 tasks: the Notion-to-Sheets move, the planet tracker, and a Discord bot research task. Three were inconclusive and 14 failed. Simple-looking tasks often took days, and it was hard to predict which would work.
- Worth knowing
- Devin starts at $500 per month. It kept pushing on impossible tasks, such as a Railway deployment, for over a day instead of stopping, so set time limits.
Try it yourself with Devin
Pull the data from my Notion database [database name or link] into a new Google Sheet, with one column per Notion property and one row per entry. Keep the Sheet in a shared location I can open, and tell me the link when the row count in the Sheet matches the Notion database. Ask me before overwriting or deleting anything that already exists.
Source: theregister.com · Jan 23, 2025
Five of these in your inbox every morning
The best things people got an AI agent to do, each with the prompt to try it.
More like this
Hand narrow code changes to Devin for pull requests
A team used Devin for a month on small fixes like chart formatting and API edge cases, with tests and PRs; a complex full-stack task went poorly.
Try Devin on research tasks (mostly failed)
Answer.AI had Devin fetch an author's recent papers and research transcript summarization; it got stuck parsing HTML and returned generic results, rated a failure.
Build a Pong game and website from scratch
A tester asked Devin to create a basic Pong-style game and a website, and it finished both in under 20 minutes.
- Claude
Build a C compiler with a team of parallel agents
Anthropic's engineering write-up on tasking Opus 4.6 agent teams with building a C compiler.
- Custom agent
Audit a codebase for redundant dependencies and polyfills
An MCP server lets an agent check a codebase for redundant dependencies and polyfills, usable remotely or as a local stdio server.
Build a budgeting app from a single prompt
A low-coder used Replit Agent to build a 'Budget Buddy' with category budgets, a spending dashboard and expense log in about 20 minutes, using half their monthly credits.