Five benchmarks. Five perfect scores.

XBOW validation benchmark

What it tests. An open-source benchmark maintained by the XBOW project: 104 challenges spanning 18 vulnerability categories, from XSS (23 challenges) and IDOR (15) to HTTP request smuggling, race conditions, and Phar deserialization. Challenges are designed to be realistic and representative of production web applications.

RedPick's result. RedPick solved 104 out of 104 challenges in pure black-box, no-hint mode, the hardest testing configuration. The benchmark's own creators score 85%. The next best black-box result is 91% (with hints). Shannon Lite reaches 96.15%, but with full source code access.

Next best: 96.15% (white-box, with source code)

PortSwigger Web Security Academy

What it tests. The industry-standard training platform for web application security: 274 labs across 31 vulnerability categories and 3 difficulty tiers (Apprentice, Practitioner, Expert). Categories include SQL injection, XSS, CSRF, SSRF, XXE, deserialization, access control, HTTP request smuggling, web cache poisoning, prototype pollution, and DOM-based vulnerabilities.

RedPick's result. RedPick completed all 274 labs plus 5 mystery labs (unreleased challenges provided directly by PortSwigger) with a 100% success rate, and achieved the EXPERT proficiency level, the highest tier in PortSwigger's classification.

HackBench

What it tests. A benchmark for evaluating autonomous cybersecurity agents on real-world software: 16 CVE-based challenges across 3 difficulty tiers (Easy, Medium, Hard) running full application stacks, including WordPress with LearnPress, Chatwoot, XWiki, Lucee Server, and CKEditor, with a maximum score of 4,000 points.

RedPick's result. RedPick scored 16 out of 16 challenges with a perfect 4,000 out of 4,000 points in black-box mode. No other publicly reported autonomous tool has achieved a perfect score on HackBench.

ProjectDiscovery Vibe-Coding Benchmark

What it tests. Three full-stack web applications (Vaultbank, Medportal, Claimflow) built by an AI coding agent and seeded with a curated 74-vulnerability answer key. It spans critical business-logic flaws, authentication and authorization failures, IDOR, mass assignment, CSRF, weak crypto, and a long tail of low and informational findings.

RedPick's result. RedPick reached 74/74 ground-truth coverage with 0 false positives, and verified 78 additional code-backed vulnerabilities outside the answer key: 152 total confirmed findings and 10 end-to-end attack chains (8 Critical, 2 High). The Neo baseline published by ProjectDiscovery scored 66/74 with 5 false positives.

Next best: 66/74 (Neo baseline, 5 false positives)

Escape Duck Store

What it tests. A deliberately vulnerable FastAPI and React e-commerce app with a documented REST API, used in Escape's April 2026 comparison of agentic pentesting tools. Escape scored five tools against 20 known vulnerabilities: its own multi-model tool led at 15/20, with a raw Claude Code (Opus 4.6) baseline at 14/20.

RedPick's result. RedPick found all 20 known vulnerabilities in a single source-free grey-box run (URL, the OpenAPI pointer, and default credentials only, no source code), and kept going: 88 validated extra findings beyond the answer key at 95.6% precision. Caveat: RedPick was not part of Escape's study and these counts are self-scored, not validated by Escape.

Next best: 15/20 (Escape's own multi-model tool)