G-Cap: A Game Character Caption Generator
Yang Yang, Feng Hu, Haiming Zhang, X. U. Cheng, Gui Zheng, Liang Yao, Wenqi Ren
摘要
While Large Vision-Language Models (LVLMs) have demonstrated remarkable proficiency in image captioning, existing research primarily focuses on real-world scenarios, leaving surreal, highly stylized, and semantically hybrid virtual-world scenarios significantly underexplored. In this work, we introduce Game Character Captioning, a novel task designed to evaluate LVLMs' capability to perceive and describe game character from the virtual-world. To facilitate evaluation, we establish GC-Bench, a manually annotated benchmark, and propose Graph-F1 to effectively assess performance on this task. Our evaluation reveals that: (1) current state-of-the-art LVLMs, including closed-source giants such as Gemini 3 Pro and GPT-5.1, struggle to maintain the high performance seen in real-world scenarios; and
(2) a notable gap exists between open-source and closed-source models. To bridge this gap, we construct GC-148K, a large-scale dataset generated via a specialized data pipeline, and develop the G-Cap series. Experiments demonstrate that G-Cap series rivals the performance of advanced closed-source models at a lower cost, offering an efficient solution for industrial-grade production environment. The code will be released at https://github.com/AZYoung233/G-Cap.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper7
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 被引用 11,349 次
- CLIPScore: A Reference-free Evaluation Metric for Image CaptioningJack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras 等EMNLP 2021 · 被引用 937 次
- ScaleCap: Scalable Image Captioning via Dual-Modality DebiasingLong Xing, Qidong Huang, Xiaoyi Dong, Pan Zhang 等ICLR 2026 · 被引用 11 次
- FLEUR: An Explainable Reference-Free Evaluation Metric for Image Captioning Using a Large Multimodal ModelYebin Lee, Imseong Park, Myungjoo KangACL 2024 · 被引用 3 次
- Visual Fact Checker: Enabling High-Fidelity Detailed Caption GenerationYunhao Ge, Xiaohui Zeng, Jacob Samuel Huffman, Tsung-Yi Lin 等CVPR 2024
相关 Paper
- What Limits Virtual Agent Application? OmniBench: A Scalable Multi-Dimensional Benchmark for Essential Virtual Agent CapabilitiesWendong Bu, Yang Wu, Qifan Yu, Minghe Gao 等ICML 2025
- Evaluating Multimodal Large Language Models on Video Captioning via Monte Carlo Tree SearchLinhao Yu, Xingguang Ji, Yahui Liu, Fanheng Kong 等ACL 2025 · 被引用 2 次
- Game Ground Bench: Probing the Limits of LVLMs in Complex Semantic Grounding Across Game UniversesZhangyang Qi, Jinsong Li, Hongjian Wu, Jiaqi Wang 等AAAI 2026
- IF-VidCap: Can Video Caption Models Follow Instructions?Shihao Li, Yuanxing Zhang, Jiangtao Wu, Zhide Lei 等ICLR 2026 · 被引用 7 次
- IV-Bench: A Benchmark for Image-Grounded Video Perception and Reasoning in Multimodal LLMsDavid Ma, Yuanxing Zhang, Jincheng Ren, Jiawei Guo 等ICLR 2026 · 被引用 5 次
