G-Cap: A Game Character Caption Generator
Yang Yang, Feng Hu, Haiming Zhang, X. U. Cheng, Gui Zheng, Liang Yao, Wenqi Ren
Abstract
While Large Vision-Language Models (LVLMs) have demonstrated remarkable proficiency in image captioning, existing research primarily focuses on real-world scenarios, leaving surreal, highly stylized, and semantically hybrid virtual-world scenarios significantly underexplored. In this work, we introduce Game Character Captioning, a novel task designed to evaluate LVLMs' capability to perceive and describe game character from the virtual-world. To facilitate evaluation, we establish GC-Bench, a manually annotated benchmark, and propose Graph-F1 to effectively assess performance on this task. Our evaluation reveals that: (1) current state-of-the-art LVLMs, including closed-source giants such as Gemini 3 Pro and GPT-5.1, struggle to maintain the high performance seen in real-world scenarios; and
(2) a notable gap exists between open-source and closed-source models. To bridge this gap, we construct GC-148K, a large-scale dataset generated via a specialized data pipeline, and develop the G-Cap series. Experiments demonstrate that G-Cap series rivals the performance of advanced closed-source models at a lower cost, offering an efficient solution for industrial-grade production environment. The code will be released at https://github.com/AZYoung233/G-Cap.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on7
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 11,349 citations
- CLIPScore: A Reference-free Evaluation Metric for Image CaptioningJack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras et al.EMNLP 2021 · 937 citations
- ScaleCap: Scalable Image Captioning via Dual-Modality DebiasingLong Xing, Qidong Huang, Xiaoyi Dong, Pan Zhang et al.ICLR 2026 · 11 citations
- FLEUR: An Explainable Reference-Free Evaluation Metric for Image Captioning Using a Large Multimodal ModelYebin Lee, Imseong Park, Myungjoo KangACL 2024 · 3 citations
- Visual Fact Checker: Enabling High-Fidelity Detailed Caption GenerationYunhao Ge, Xiaohui Zeng, Jacob Samuel Huffman, Tsung-Yi Lin et al.CVPR 2024
Related papers
- What Limits Virtual Agent Application? OmniBench: A Scalable Multi-Dimensional Benchmark for Essential Virtual Agent CapabilitiesWendong Bu, Yang Wu, Qifan Yu, Minghe Gao et al.ICML 2025
- Evaluating Multimodal Large Language Models on Video Captioning via Monte Carlo Tree SearchLinhao Yu, Xingguang Ji, Yahui Liu, Fanheng Kong et al.ACL 2025 · 2 citations
- Game Ground Bench: Probing the Limits of LVLMs in Complex Semantic Grounding Across Game UniversesZhangyang Qi, Jinsong Li, Hongjian Wu, Jiaqi Wang et al.AAAI 2026
- IF-VidCap: Can Video Caption Models Follow Instructions?Shihao Li, Yuanxing Zhang, Jiangtao Wu, Zhide Lei et al.ICLR 2026 · 7 citations
- IV-Bench: A Benchmark for Image-Grounded Video Perception and Reasoning in Multimodal LLMsDavid Ma, Yuanxing Zhang, Jincheng Ren, Jiawei Guo et al.ICLR 2026 · 5 citations
