FinCUABuild: Can Agents Build Reliable Benchmarks for Dynamic Financial Computer Use?
Jingpu Yang , Fengxian Ji , Jinri Guo , Tianhao Li , Qian Jiang , Fan Zhang , Min Peng , Qianqian Xie , Preslav Nakov , Zhuohan Xie
- 🏛 Institutions
- Wuhan University , MBZUAI , Northeastern University , Zhongguancun Academy
- 📅 Date
- September 7, 2026
- 📑 Publisher
- arXiv
- 💻 Env
- Desktop General GUI
- 🔑 Keywords
TLDR
FinCUABuildBench evaluates whether agents can autonomously construct computer-use-agent evaluation tasks for financial scenarios, via 576 construction requests over 24 financial workflows with a task-qualification mechanism for the resulting benchmarks.
Related papers (24)
- IGG: A Benchmark for Interactive GUI Grounding under Visibility ConstraintsOctober 23, 2026 · arXiv
- PointerBench: A Diagnostic Benchmark for Fine-Grained GUI GroundingOctober 22, 2026 · arXiv
- CUA-Recovery: Benchmarking Error Recovery in Long-Horizon Computer-Use AgentsOctober 20, 2026 · arXiv
- CUA-Lite: An Open Platform for Computer Use AgentsOctober 19, 2026 · arXiv
- PersonaCUABench: Benchmarking Computer-Use Agents Serving Diverse PersonasOctober 16, 2026 · arXiv
- MMA-SafetyBench: A Benchmark for Multimodal Agent Safety EvaluationOctober 14, 2026 · arXiv
- MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer EnvironmentsOctober 14, 2026 · arXiv
- A Decade in a Day: Synthesizing Agent-Native Interfaces from Human-Oriented Software EvolutionOctober 11, 2026 · arXiv
- AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use TasksOctober 8, 2026 · arXiv
- PlaySuite: A Large-Scale Benchmark for Interactive Visual IntelligenceOctober 5, 2026 · arXiv
- MedImageOSWorld: Benchmarking GUI Agents for Medical Image ConsolesOctober 3, 2026 · arXiv
- Control OSWorld: An AI Control Environment for GUI Computer Use AgentsOctober 2, 2026 · arXiv
- cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use AgentsSeptember 30, 2026 · arXiv
- Talk2Agent: Benchmarking Voice Interfaces for Text AgentsSeptember 30, 2026 · arXiv
- OSWorld-Science: A Benchmark of Computer Use Agents for Learning and Using Scientific SoftwareSeptember 30, 2026 · arXiv
- PrecogUI: Proactive GUI Agents via Pre-cognitive Simulation and Experience RetrievalSeptember 29, 2026 · arXiv
- MatToolBench: Benchmarking Multimodal Agents in Real-World Materials Science WorkflowsSeptember 29, 2026 · arXiv
- EngiWorld: What Can Frontier Agents Deliver in Professional Engineering Environments?September 29, 2026 · arXiv
- LongPuzzleBench: Evaluating GUI Agents on Long-Horizon Visual PuzzlesSeptember 28, 2026 · arXiv
- The GUI Is Not the State: Diagnosing State Aliasing in GUI World ModelsSeptember 26, 2026 · arXiv
- CUA-SWE: When Computer-Use Agents Meet Visual Software EngineeringSeptember 26, 2026 · arXiv
- ScreenHaystack: Finding Blind Zones in GUI GroundingSeptember 25, 2026 · EMNLP 2026
- OSWorld-Pro: Process-based Evaluation for Computer Use AgentsSeptember 21, 2026 · arXiv
- RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use AgentsSeptember 18, 2026 · arXiv