ACL2025
ProBench: Judging Multimodal Foundation Models on Open-ended Multi-domain Expert Tasks
Yan Yang, Dongxu Li, Haoning Wu, Bei Chen, Liu Liu, Liyuan Pan, Junnan Li
Abstract
Query: i want you to write a Rshiny code in rstudio to generate above visualization. Can you do that? Coding; Screenshots and UI Elements Task sub-field: Code Generation Image field: Interactive Tools Keywords: Multiple complex visual elements; no domain knowledge. Query: Explain this framework to me in detail and in chronological order. I am an aspiring consultant and I need to know this. Also give me potential issues and solutions that will come uo through this.