Lune

CVPR Findings2026

DrawingVQA: A Real-World Benchmark for Multi-Depth Visual–Textual Reasoning on Construction Drawings

Yoonhwa Jung, Junryu Fu, Mani Golparvar-Fard

Abstract

We introduce DrawingVQA, the first benchmark designed to evaluate multimodal large language models (MLLMs) on real-world construction drawings-a core media in architecture, civil, and many other engineering practices. Unlike natural images or schematic floor plans, construction drawings fuse abstract geometry, symbolic notation, tabular data, annotations, and domain-specific text, forming a uniquely complex visual-textual domain core to engineering workflows. DrawingVQA bridges this gap with 33 "Issued for Construction" drawings and 92 expertly curated question-answer pairs, spanning three reasoning depths: perceptual understanding, contextual interpretation, and domain-expert reasoning. To evaluate model capabilities, we present a dual categorization framework to jointly analyze performance across seven constructionengineering and four MLLM capability dimensions-the first to explicitly map engineering workflows to AI reasoning competencies. Evaluations of state-of-the-art MLLMs reveal a substantial gap between model and expert performance, particularly at higher reasoning depths. This benchmark lays a foundation for domain-specialized multimodal reasoning to allow for advancement on integration of AI-driven understanding and real-world engineering workflows. DrawingVQA is available here: https: //joonv2.github.io/DrawingVQA/

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • MMMU: A Massive Multi-Discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI cites MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities
  • MMMU: A Massive Multi-Discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI cites Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on13

  1. Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question AnsweringPan Lu, Swaroop Mishra, Tanglin Xia, Liang Qiu et al.NeurIPS 2022 · 2,727 citations
  2. MM-Vet: Evaluating Large Multimodal Models for Integrated CapabilitiesWeihao Yu, Zhengyuan Yang, Linjie Li, Jianfeng Wang et al.ICML 2024 · 1,191 citations
  3. MMMU: A Massive Multi-Discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIXiang Yue, Yuansheng Ni, Tianyu Zheng, Kai Zhang et al.CVPR 2024 · 213 citations
  4. Deep Floor Plan Recognition Using a Multi-Task Network With Room-Boundary-Guided AttentionZhiliang Zeng, Xianzhi Li, Ying Kin Yu, Chi-Wing FuICCV 2019 · 125 citations
  5. FloorPlanCAD: A Large-Scale CAD Drawing Dataset for Panoptic Symbol SpottingZhiwen Fan, Lingjie Zhu, Honghua Li, Xiaohao Chen et al.ICCV 2021 · 53 citations

Related papers

  1. MechVQA: Benchmarking and Enhancing Multimodal LLMs on Comprehensive Mechanical Drawing UnderstandingQian Kou, Xiaofeng Shi, Yulin Li, Xiaosong Qiu et al.ICML 2026 · 2 citations
  2. PCB-Bench: Benchmarking LLMs for Printed Circuit Board Placement and RoutingJindong Li, Lianrong Chen, Bin Yang, Jiadong Zhu et al.ICLR 2026
  3. DomainCQA: Crafting Knowledge-Intensive QA from Domain-Specific ChartsYujing Lu, Ling Zhong, Jing Yang, Weiming Li et al.AAAI 2026
  4. ActiView: Evaluating Active Perception Ability for Multimodal Large Language ModelsZiyue Wang, Chi Chen, Fuwen Luo, Yurui Dong et al.ACL 2025 · 9 citations
  5. SpaCE-Eval: A Benchmark for Real-World Multi-Modal ReasoningXuyou Yang, Yucheng Zhao, Wenxuan Zhang, Immanuel KohICLR 2026
Dusk over the sea between two cliffs drawn in fine vertical lines