Lune

ACL Findings2025

TransBench: Breaking Barriers for Transferable Graphical User Interface Agents in Dynamic Digital Environments

Yuheng Lu, Qian Yu, Hongru Wang, Zeming Liu, Wei Su, Yanping Liu, Yuhang Guo, Maocheng Liang, Yunhong Wang, Haifeng Wang

Abstract

Graphical User Interface (GUI) agents, which autonomously operate on digital interfaces through natural language instructions, hold transformative potential for accessibility, automation, and user experience.

A critical aspect of their functionality is grounding -the ability to map linguistic intents to visual and structural interface elements. However, existing GUI agents often struggle to adapt to the dynamic and interconnected nature of real-world digital environments, where tasks frequently span multiple platforms and applications while also being impacted by version updates. To address this, we introduce TransBench, the first benchmark designed to systematically evaluate and enhance the transferability of GUI agents across three key dimensions: crossversion transferability (adapting to version updates), cross-platform transferability (generalizing across platforms like iOS, Android, and Web), and cross-application transferability (handling tasks spanning functionally distinct apps). TransBench includes 15 app categories with diverse functionalities, capturing essential pages across versions and platforms to enable robust evaluation. Our experiments demonstrate significant improvements in grounding accuracy, showcasing the practical utility of GUI agents in dynamic, realworld environments. Our code and data will be publicly available at TransBench.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration cites SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents
  • DocOS: Towards Proactive Document-Guided Actions in GUI Agents cites Towards Conversational Recommendation over Multi-Type Dialogs
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. PRIM: Towards Practical In-Image Multilingual Machine TranslationYanzhi Tian, Zeming Liu, Zhengyang Liu, Chong Feng et al.EMNLP 2025 · 4 citations
  2. DocOS: Towards Proactive Document-Guided Actions in GUI AgentsJingjing Liu, Ziye Huang, Zihao Cheng, Zeming Liu et al.ICML 2026

Builds on13

  1. AgentBench: Evaluating LLMs as AgentsXiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu et al.ICLR 2024 · 748 citations
  2. Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent CollaborationJunyang Wang, Haiyang Xu, Haitao Jia, Xi Zhang et al.NeurIPS 2024 · 245 citations
  3. Towards Conversational Recommendation over Multi-Type DialogsZeming Liu, Haifeng Wang, Zheng-Yu Niu, Hua Wu et al.ACL 2020 · 157 citations
  4. Mapping Natural Language Instructions to Mobile UI Action SequencesYang Li, Jiacong He, Xin Zhou, Yuan Zhang et al.ACL 2020 · 75 citations
  5. SeeClick: Harnessing GUI Grounding for Advanced Visual GUI AgentsKanzhi Cheng, Qiushi Sun, Yougang Chu, Fangzhi Xu et al.ACL 2024 · 33 citations

Related papers

  1. MMBench-GUI: A Unified Hierarchical Evaluation Framework for Multi-Platform GUI AgentsXuehui Wang, Zhenyu Wu, JingJing Xie, Zichen Ding et al.CVPR 2026
  2. MobileBench-OL: A Comprehensive Chinese Benchmark for Evaluating Mobile GUI Agents in Real-World EnvironmentQinzhuo Wu, Zhizhuo Yang, Hanhao Li, Pengzhi Gao et al.ACL Findings 2026
  3. ProBench: Benchmarking GUI Agents with Accurate Process InformationLeyang Yang, Ziwei Wang, Xiaoxuan Tang, Sheng Zhou et al.AAAI 2026
  4. VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability DiagnosticsYichen Gong, Zhuohan Cai, Sunhao Dai, Yuqi Zhou et al.ICML 2026 · 1 citation
  5. FedGUI: Benchmarking Federated GUI Agents across Heterogeneous Platforms, Devices, and Operating SystemsWenhao Wang, Haoting Shi, Mengying Yuan, Yiquan Lin et al.ACL Findings 2026
Dusk over the sea between two cliffs drawn in fine vertical lines