Subscribe

Which coding agents have public SWE-bench results?

Entries from the official SWE-bench leaderboard data file that name a product we track (or its open-source core). Scores are the percentage of tasks resolved, as published.

Entries shown
15
Products with an entry
3
Leaderboard rows scanned
323
Pulled
Nov 4, 2026
BoardSubmissionResolvedDateProduct
MultilingualGPT 5.2 CodexSWE-agent66.3%2026-02-20Codex cloudModel in another harness, not the Codex cloud product
VerifiedGPT 5.2 CodexSWE-agent72.8%2026-02-19Codex cloudModel in another harness, not the Codex cloud product
VerifiedGPT 5.1 Codex (medium)SWE-agent66.0%2025-11-24Codex cloudModel in another harness, not the Codex cloud product
LiteFactory Code Droid31.33%2024-06-17Factory Droids
TestFactory Code Droid19.27%2024-06-17Factory Droids
VerifiedFactory Code Droid37.0%2024-06-17Factory Droids
VerifiedGoogle Jules + Gemini 2.0 Flash (v20241212-experimental)Google52.2%2024-12-12Jules
LiteOpenHands + CodeAct v2.1 (claude-3-5-sonnet-20241022)OpenHands41.67%2024-10-25OpenHands Cloud
LiteOpenHands + CodeAct v1.8OpenHands26.67%2024-07-25OpenHands Cloud
MultimodalOpenHands-Versa (Claude-Sonnet 4)OpenHands34.43%2025-05-28OpenHands Cloud
MultimodalOpenHands-Versa (Claude-3.7 Sonnet)OpenHands31.33%2025-05-09OpenHands Cloud
TestOpenHands + CodeAct v2.1 (claude-3-5-sonnet-20241022)OpenHands29.38%2024-11-03OpenHands Cloud
VerifiedOpenHands + GPT-5OpenHands71.8%2025-08-07OpenHands Cloud
VerifiedOpenHands + Claude 4 SonnetOpenHands70.4%2025-05-24OpenHands Cloud
VerifiedOpenHands + Qwen3-Coder-480B-A35B-InstructQwen69.6%2025-08-05OpenHands Cloud

Source: SWE-bench leaderboards.json · checked 2026-11-04

No product entry

Devin, Claude Code on the web, Cursor Cloud Agents, GitHub Copilot cloud agent, Replit Agent, Lovable, Bolt.new, v0, Base44, Firebase Studio, Kiro, Amp have no entry under their own name on any SWE-bench board. Vendors often publish model scores in their own announcements; we only list entries on the official leaderboard so numbers are comparable.

Read with care

Weekly, free

Which coding agent changed this week

One short email when coding agents and app builders change prices, limits, MCP support or benchmark results. Every item links its source.

You'll finish signing up on beehiiv.