CAPTCHA Solving

Benchmarks

Dataset Name	SOTA Method	Metric
Xiaodun (test)	VIPER (R3)	Accuracy92.59	19	3mo ago
Shumei (test)		Accuracy99.87	19	3mo ago
DingX (test)		Accuracy95.4	19	3mo ago
NEase (test)		Accuracy95.12	19	3mo ago
Geetest (test)		Accuracy90.7	19	3mo ago
VTT (test)	VIPER (R3)	Accuracy97.33	19	3mo ago
CaptchaBench	CaptchaMind	Average Success Rate82.9	11	14d ago
Xiaodun VRC Platform (test)		Mean Response Time (s)0.05	9	3mo ago
Shumei VRC Platform (test)		Mean Response Time (s)0.05	9	3mo ago
DingXiang VRC Platform (test)		Mean Response Time (s)0.05	9	3mo ago
NetEase VRC Platform (test)		Mean Response Time (s)0.05	9	3mo ago
Geetest VRC Platform (test)		Mean Response Time (s)0.05	9	3mo ago
VTT VRC Platform (test)		Mean Response Time (s)0.05	9	3mo ago
Dynamic CAPTCHA system (held-out test)	ReCAP-32B	SR Text62.11	7	2mo ago
Next-Gen CAPTCHAs		Avg Pass@198.8	7	3mo ago
OpenCaptchaWorld	CaptchaMind	Average Success Rate66.2	5	14d ago
yandex/kaleidoscope CAPTCHA zero-shot		Solve Rate47	5	2mo ago
geetest/gobang CAPTCHA zero-shot		Solve Rate36	5	2mo ago
geetest/iconcrush CAPTCHA zero-shot		Solve Rate70	5	2mo ago
geetest/icon CAPTCHA zero-shot	ReCAP-32B	Solve Rate (Zero-Shot)10	5	2mo ago
arkose/numbermatch CAPTCHA zero-shot	ReCAP-32B	Solve Rate28	5	2mo ago
arkose rockstack CAPTCHA zero-shot	ReCAP-32B	Solve Rate22	5	2mo ago
arkose/orbit_match CAPTCHA zero-shot	ReCAP-32B	Solve Rate20	5	2mo ago
arkose/dice_match CAPTCHA zero-shot	ReCAP-32B	Solve Rate15	5	2mo ago
arkose/3d_rollball CAPTCHA zero-shot	ReCAP-32B	Solve Rate32	5	2mo ago

Showing 25 of 42 rows