CaptchaAgent: Verifiable Visual Reasoning for CAPTCHA Solving
Shangquan Sun , Ruoyu Chen , Zhirui Liu , Xiang Liu , Chenghao Qian , Wenqi Ren , Xiaochun Cao
- 🏛 Institutions
- NTU , UCAS , Sun Yat-sen University , Beihang University , University of Leeds
- 📅 Date
- October 9, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Web
- 🔑 Keywords
TLDR
Presents CaptchaAgent, an agent framework for reasoning-intensive CAPTCHAs combining count-committed visual perception with verified browser interaction. Evaluated across diverse modern CAPTCHA suites, CaptchaAgent improves Pass@1 by 21.3-25.8 percentage points over standard VLM baselines.
Related papers (24)
- Are CAPTCHAs Still Bot-hard? Generalized Visual CAPTCHA Solving with Agentic Vision Language ModelAugust 2025 · USENIX Security 2025
- CaptchaArena: A Large-Scale, Fine-Grained Dataset for Training Computer-Use Agents on Interactive CAPTCHAsSeptember 25, 2026 · arXiv
- Invisible in Space, Visible in Time: Motion Vision CAPTCHA against GUI AgentsSeptember 23, 2026 · ACM MM 2026
- Why Do LLM-based Web Agents Fail? A Hierarchical Planning PerspectiveMarch 15, 2026 · arXiv
- Next-Gen CAPTCHAs: Leveraging the Cognitive Gap for Scalable and Diverse GUI-Agent DefenseFebruary 9, 2026 · ICML 2026
- VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?April 9, 2024 · COLM 2024
- GPT-4V(ision) is a Generalist Web Agent, if GroundedJanuary 3, 2024 · ICML 2024
- Correct Answers, Closed Gates: SolveBind for GUI Agents at the Verification BarrierOctober 23, 2026 · arXiv
- CAPTCHA Solving for Native GUI Agents: Automated Reasoning-Action Data Generation and Self-Corrective TrainingMarch 23, 2026 · arXiv
- Building Autonomous GUI Navigation via Agentic-Q Estimation and Step-Wise Policy OptimizationFebruary 14, 2026 · arXiv
- SVRepair: Structured Visual Reasoning for Automated Program RepairFebruary 5, 2026 · arXiv
- Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMsApril 8, 2024 · ECCV 2024 (Poster)
- What Does "Now" Mean to Your Computer-Use Agent? Stale Screenshots, Page Loads, and Which Check to Run Before a ClickOctober 29, 2026 · arXiv
- InterA11y: Interactive Web Accessibility Error Detection with LLM AgentsOctober 29, 2026 · arXiv
- AgentHeal: Evaluating Goal-Preserving Resource Recovery of Web Agents under Access BarriersOctober 29, 2026 · arXiv
- WebAnything: From the Wild Web to Scalable Agent EnvironmentsOctober 27, 2026 · arXiv
- SkillLifeBench: Benchmarking Security Across the Lifecycle of Agent SkillsOctober 26, 2026 · arXiv
- Back to Basics: A Skill-Centric Approach to Generalist Web AgentsOctober 26, 2026 · arXiv
- AgentProofBench: Benchmarking Reusable Verifiers for Web AgentsOctober 25, 2026 · arXiv
- SkillShift-Bench: Benchmarking Skill Learning under Environment Evolution for Web AgentsOctober 24, 2026 · arXiv
- Seeing the Options: Typed Decisions over Visual Candidates with Reusable Option MemoryOctober 24, 2026 · arXiv
- Learning What to Ask for Tomorrow: Active Preference Acquisition for Long-Term Personalized Web AgentsOctober 22, 2026 · arXiv
- Step-Aligned Script Generation with Verification and Recovery for Web Automation TestingOctober 19, 2026 · arXiv
- LoWAgent: A Low-Resource Multilingual Benchmark for Web AgentsOctober 19, 2026 · arXiv