Build a pull request review agent with Copilot
A developer was asked by their company to build a PR-review agent with Copilot and was considering a custom API approach for Azure since native review is GitHub-only.
Done withGitHub Copilot
- What they did
- The post is a developer asking how to make an AI PR reviewer with GitHub Copilot for repositories hosted in Azure DevOps, since native Copilot PR review is GitHub-only. In the comments, people describe workable setups: triggering a CLI agent or custom Node/Python service from Azure Pipelines or webhooks, reading the PR diff with Azure DevOps APIs, running an LLM review, and posting comments back; some also mention triggering it from a PR comment.
- How it went
- There is no reported build or result from the original poster. The concrete outcomes come from commenters, who say similar setups worked well, could review against acceptance criteria, suggest or even apply changes, and help with bulk issue handling, but they also note GitHub-only limitations and awkward pricing or setup for Azure DevOps.
- Worth knowing
- One commenter said matching the agent’s environment to developers’ tools in a devcontainer takes some work but lets it build, lint, test, and run the code.
Try it yourself with GitHub Copilot
Help me design a pull request review agent for our team's repos on [GitHub/Azure DevOps]. Draft a review checklist covering [correctness, security, style, test coverage], and write a script that fetches a PR's diff through the [platform] API, sends it to a model with that checklist, and prints the comments. It's finished when I can run it on [a sample PR] and see comments, and it must not post anything to the PR until I confirm.
Want help getting this working? Join the Vibe Coding Academy ↗ Run by Alex Finn, who also runs this site.
Source: Reddit · Undated
Related use cases
Run a solo company with eight agent departments
A founder set up CEO, CFO, COO, lawyer, accountant, marketing, CTO, and improver agents that share memory and consult each other.
Iterate on tasks with Copilot CLI autopilot and fleet
The author used autopilot to iterate until done and /fleet to split work across parallel subagents, noting overhead on small tasks.
Assign GitHub issues to Copilot coding agent
A developer assigned a GitHub issue to Copilot and watched it work, but it started from the default branch instead of the intended feature branch.
Build a C compiler with a team of parallel agents
Anthropic's engineering write-up on tasking Opus 4.6 agent teams with building a C compiler.
Refactor a million-line repo with 1,393 subagents
A Nous Research developer had Hermes dispatch 1,393 subagents over about 19 hours to clean up its own repo, cutting non-test Python source by 34.4% in a merged PR.
Build a mobile app turning photos and voice into reminders
The poster built Loopi, an app that turns photos, text and voice into reminders, notes and expenses, in about 45 days using Replit and AI agents.
Get 5 like this every morning
The best things people got an AI agent to do, each with the prompt to try it.