AdaQE-CG: Adaptive Query Expansion for Web-Scale Generative AI Model and Data Card Generation
Haoxuan Zhang, Ruochi Li, Zhenni Liang, Mehri Sattari, Phat Vo, Collin Qu, Ting Xiao, Junhua Ding, Yang Zhang, Haihua Chen
Abstract
Transparent and standardized documentation is essential for building trustworthy generative AI (GAI) systems. However, current automated model and data card generation methods still face three key challenges: (i) Static templates. Most systems rely on fixed query templates that cannot adapt to diverse paper structures or evolving documentation requirements. (ii) Information scarcity. Web-scale repositories such as Hugging Face often provide incomplete or inconsistent metadata, resulting in missing or noisy information. (iii) Lack of benchmarks. The absence of standardized datasets and evaluation protocols prevents fair and reproducible assessment of documentation quality. To address these challenges, we propose AdaQE-CG, an Adaptive Query Expansion for Card Generation framework that integrates dynamic information extraction with cross-card knowledge transfer. The Intra-Paper Extraction via Context-Aware Query Expansion (IPE-QE) module iteratively refines extraction queries to capture richer and more complete information from scientific papers and repositories. The Inter-Card Completion using the MetaGAI Pool (ICC-MP) module enriches missing fields by transferring semantically relevant content from similar cards within a curated dataset. In addition, we construct MetaGAI-Bench, the first large-scale, expert-annotated benchmark for evaluating GAI documentation. Comprehensive experiments across five quality dimensions demonstrate that AdaQE-CG significantly outperforms existing approaches, surpasses human-authored data cards, and approaches human-level quality for model cards. Code, prompts, and data are publicly available at: https://github.com/haoxuan-unt2024/AdaQE-CG.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 8d9c723e-f2be-4153-95b7-4dc21ecd4cb0Builds on5
- BERTScore: Evaluating Text Generation with BERTTianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger et al.ICLR 2020 · 8,443 citations
- Can Large Language Models Be an Alternative to Human Evaluations?David Cheng-Han Chiang, Hung-yi LeeACL 2023 · 254 citations
- Nougat: Neural Optical Understanding for Academic DocumentsLukas Blecher, Guillem Cucurull, Thomas Scialom, Robert StojnicICLR 2024 · 243 citations
- Navigating Dataset Documentations in AI: A Large-Scale Analysis of Dataset Cards on HuggingFaceXinyu Yang, Weixin Liang, James ZouICLR 2024 · 41 citations
- AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale CorporaJiaxin Bai, Wei Fan, Qi Hu, Qing Zong et al.ACL 2026 · 27 citations
Related papers
- AirQA: A Comprehensive QA Dataset for AI Research with Instance-Level EvaluationTiancheng Huang, Ruisheng Cao, Yuxin Zhang, Zhangyi Kang et al.ICLR 2026 · 1 citation
- TabReX: Tabular Referenceless eXplainable EvaluationTejas Anvekar, Junha Park, Aparna Garimella, Vivek GuptaACL 2026
- MEBench: Benchmarking Large Language Models for Cross-Document Multi-Entity Question AnsweringTeng Lin, Yuyu Luo, Honglin Zhang, Jicheng Zhang et al.EMNLP 2025 · 2 citations
- Dialogue Benchmark Generation from Knowledge Graphs with Cost-Effective Retrieval-Augmented LLMsReham Omar, Omij Mangukiya, Essam MansourSIGMOD 2025 · 9 citations
- AIR-Bench: Automated Heterogeneous Information Retrieval BenchmarkJianlyu Chen, Nan Wang, Chaofan Li, Bo Wang et al.ACL 2025
