BIMgent: Towards Autonomous Building Modeling via Computer-use Agents

Zihan Deng , Changyu Du , Stavros Nousias , André Borrmann

🏛 Institutions: TUM , TUM Georg Nemetschek Institute
📅 Date: June 8, 2025
📑 Publisher: ICML 2025 Workshop on Computer-use Agents
💻 Env: Desktop
🔑 Keywords: framework building information modeling GUI authoring AEC BIMgent

TLDR

BIMgent studies whether general computer-use agents can handle specialized Building Information Modeling software rather than ordinary desktop tasks. It proposes an MLLM-based framework for conceptual design input, software-specific planning, and GUI execution, and reports nontrivial success on real-world 3D building authoring tasks where baseline agents fail.

Open paper arXiv Report issue