GenNI: Human-AI Collaboration for Data-Backed Text Generation
Hendrik Strobelt, Jambay Kinley, Robert Krüger, Johanna Beyer, Hanspeter Pfister, Alexander M. Rush
Abstract
Table2Text systems generate textual output based on structured data utilizing machine learning. These systems are essential for fluent natural language interfaces in tools such as virtual assistants; however, left to generate freely these ML systems often produce misleading or unexpected outputs. GenNI (Generation Negotiation Interface) is an interactive visual system for high-level human-AI collaboration in producing descriptive text. The tool utilizes a deep learning model designed with explicit control states. These controls allow users to globally constrain model generations, without sacrificing the representation power of the deep learning models. The visual interface makes it possible for users to interact with AI systems following a Refine-Forecast paradigm to ensure that the generation system acts in a manner human users find suitable. We report multiple use cases on two experiments that improve over uncontrolled generation approaches, while at the same time providing fine-grained control. A demo and source code are available at https://genni.vizhub.ai.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on5
- Neural Data-to-Text Generation via Jointly Learning the Segmentation and CorrespondenceXiaoyu Shen, Ernie Chang, Hui Su, Cheng Niu et al.ACL 2020 · 46 citations
- TaPas: Weakly Supervised Table Parsing via Pre-trainingJonathan Herzig, Pawel Krzysztof Nowak, Thomas Müller, Francesco Piccinno et al.ACL 2020 · 19 citations
- CoCon: A Self-Supervised Approach for Controlled Text GenerationAlvin Chan, Yew-Soon Ong, Bill Pung, Aston Zhang et al.ICLR 2021 · 16 citations
- Latent Template Induction with Gumbel-CRFsYao Fu, Chuanqi Tan, Bin Bi, Mosha Chen et al.NeurIPS 2020 · 15 citations
- Posterior Control of Blackbox GenerationXiang Lisa Li, Alexander M. RushACL 2020 · 2 citations
Related papers
- DuetUI: A Bidirectional Context Loop for Human-Agent Co-Generation of Task-Oriented InterfacesYuan Xu, Shaowen Xiang, Yizhi Song, Ruoting Sun et al.CHI 2026 · 2 citations
- Interaction Methods in Generative AI Image Tools: A Review of Trends and Design Opportunities Across HCI and IndustryHyerim Park, Malin Eiband, André Luckow, Michael SedlmairCHI 2026 · 2 citations
- GenZI: Zero-Shot 3D Human-Scene Interaction GenerationLei Li, Angela DaiCVPR 2024
- Bridging Gulfs in UI Generation through Semantic GuidanceSeokhyeon Park, Soohyun Lee, Eugene Choi, Hyunwoo Kim et al.CHI 2026 · 3 citations
- GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment DesignWen-Fan Wang, Ting-Ying Lee, Chien-Ting Lu, Che-Wei Hsu et al.UIST 2025 · 4 citations
