Remove stale feature flags and fix CI via automated PRs
Ramp built Devin workflows where an engineer enters a feature flag and Devin opens a PR removing it; it also fixed flaky tests and CI issues (vendor case study).
Done withDevin
- What they did
- Ramp used Devin's API to run many Devins in parallel. For feature flags, a playbook prompt split the removal across worker Devins, each handling assigned files. A clean-up Devin merged their output into one PR. This sits behind an internal admin-dashboard tool, so an engineer enters a flag and gets tagged on the PR. For slow tests, scripts checked that coverage was unchanged.
- How it went
- Ramp removed 150 complex feature flags in a month, which an engineer credits with over 1000 hours saved. Overall it reports about 80 merged PRs a week. Airflow fixes averaged 8 minutes from bug to PR, and half could be merged as-is.
- Worth knowing
- Validation scripts, such as a coverage-regression check for slow tests, kept failed attempts from surfacing as PRs, so review bandwidth was the only limit on parallelism.
Try it yourself with Devin
In my repo [repo name], remove the feature flag [flag name] and keep the behavior of the [enabled/disabled] path everywhere it's used. Delete the flag definition, dead branches, and related tests or config, then run the test suite and fix anything that breaks. Open a pull request with a summary of every file changed. Show me the PR for review and do not merge it.
Want help getting this working? Join the Vibe Coding Academy ↗ Run by Alex Finn, who also runs this site.
Source: archive-devin-ai.lusion.co · Undated
Related use cases
Hand narrow code changes to Devin for pull requests
A team used Devin for a month on small fixes like chart formatting and API edge cases, with tests and PRs; a complex full-stack task went poorly.
Migrate an Electron app from Vue 2 to Vue 3
Kearney gave Devin repo access to migrate a production Electron app to Vue 3 and update npm packages, committing after every five components.
Build a deals page step by step with Devin
An engineer had Devin implement a deals page in steps; it opened a PR in under 10 minutes, but CI failed, it added unnecessary changes and gave a false answer about a library.
Build a C compiler with a team of parallel agents
Anthropic's engineering write-up on tasking Opus 4.6 agent teams with building a C compiler.
Patch annoying software behavior by pointing an agent at it
Author had an agent debug a Hyper-V vmconnect fullscreen bug with a hook system, and pointed Codex at the Codex app to add features.
Cross-check coding agent answers with a second agent
The poster built a tool that automatically sends Claude Code responses to Codex for a second opinion, replacing manual copy-pasting.
Get 5 like this every morning
The best things people got an AI agent to do, each with the prompt to try it.