Copilot tops GitHub’s own AI code review benchmark. An independent one tells a different story.

If there’s one thing the AI software engineering world doesn’t lack, it’s benchmarks. Want to know whether an agent can resolve real-world GitHub issues? There’s SWE-bench . Or how about seeing how well it can operate inside a terminal? Terminal-Bench has you covered. Now, GitHub has decided AI code review needs another yardstick. On Monday, the company unveiled ReviewBench , an open benchmark developed with Microsoft for measuring how well AI code review agents find useful problems in pull requests. And sitting at the top of its inaugural leaderboard is — perhaps unsurprisingly — GitHub...

Source: The New Stack

← Back to News