There's a WebVoyager leaderboard. There's Skyvern's form-fill score. Neither grades what breaks agents in production: captchas, date pickers, conditional fields, real government sites. Forms-50 does. 50 production forms across 5 categories — government, financial, healthcare, commerce, hiring. Public leaderboard, open methodology, one persona, five axes.
Prior art, credited: Skyvern 2.0 reports 85.85% on WebVoyager. Surfer 2 claims 97.1%. Both benchmarks mix search, click, and fill — not a form-fill-only score on hard production targets. This is the gap Forms-50 fills. First public row below. Submit your own at the bottom.
| Agent | Completion | Accuracy | Avg time | Avg cost | Top failure |
|---|---|---|---|---|---|
|
Claude (browser tools)
claude-opus-4-7 + Chrome MCP
|
— | — | — | — | run scheduled |
|
Skyvern 2.0
self-reported · WebVoyager
|
85.85% | — | — | — | diff. benchmark |
|
Surfer 2
self-reported · WebVoyager
|
97.1% | — | — | — | diff. benchmark |
|
Cai Layer
PH launch · Apr 22 2026
|
No submissions yet — submit a run | ||||
|
HARPA
v9.x · browser extension
|
No submissions yet — submit a run | ||||
|
Browser Use
open-source · GitHub
|
No submissions yet — submit a run | ||||
|
OpenAI Operator
computer-use-preview
|
No submissions yet — submit a run | ||||
|
Dassi
browser-agent demo
|
No submissions yet — submit a run | ||||
Test User, 1234 Example St, San Francisco CA 94110, DOB 1990-01-15, phone 415-555-0100, email test@example.com. Listed in full in the GitHub repo.date-picker, multi-select, conditional-fields, captcha, iframe, file-upload, multi-step-nav, auth-wall, infinite-loop, wrong-value. Used to compare agents on what they specifically can't do.Pick 1 form or all 10. Run your agent through the methodology above. Email the results — completion, accuracy, time, cost per form, plus failure mode tags. We'll publish your row on the leaderboard within 48 hours. Verified runs (observed live over screenshare) get a Verified badge.