BIMgent: Towards Autonomous Building Modeling via Computer-use Agents
Zihan Deng, Changyu Du, Stavros Nousias, André Borrmann
- 🏛 Institutions
- TUM, TUM Georg Nemetschek Institute
- 📅 Date
- June 8, 2025
- 📑 Publisher
- ICML 2025 Workshop on Computer-use Agents
- 💻 Env
- Desktop
- 🔑 Keywords
TLDR
BIMgent studies whether general computer-use agents can handle specialized Building Information Modeling software rather than ordinary desktop tasks. It proposes an MLLM-based framework for conceptual design input, software-specific planning, and GUI execution, and reports nontrivial success on real-world 3D building authoring tasks where baseline agents fail.
Related papers
- VLAA-GUI: Knowing When to Stop, Recover, and Search, A Modular Framework for GUI AutomationApril 23, 2026 · arXiv
- EE-MCP: Self-Evolving MCP-GUI Agents via Automated Environment Generation and Experience LearningApril 10, 2026 · arXiv
- ShowUI-Aloha: Human-Taught GUI AgentJanuary 12, 2026 · arXiv
- Surfer 2: The Next Generation of Cross-Platform Computer Use AgentsOctober 22, 2025 · arXiv
- LiteCUA: Computer as MCP Server for Computer-Use Agent on AIOSMay 24, 2025 · arXiv
- UFO2: The Desktop AgentOSApril 20, 2025 · arXiv