Lune

ACM MM2020Top-tier venue

Diverter-Guider Recurrent Network for Diverse Poems Generation from Image

Liang Li, Shijie Yang, Li Su, Shuhui Wang, Chenggang Yan, Zhengjun Zha, Qingming Huang

Abstract

Poem generation from image aims to automatically generate the poetic sentences for presenting the image content or overtone. Previous works focused on 1-to-1 image-poem generation with the demands of poeticness and content relevance. This paper proposes the paradigm of multiple poems generation from one image, which is closer to human poetizing but more challenging. Its key problem is to simultaneously guarantee the diversity of multiple poems with poeticness and relevance. To this end, we propose an end-to-end probabilistic Diverter-Guider Recurrent Network (DG-Net), which is a context-based encoder-decoder generative model with the hierarchical stochastic variables. Specifically, the diverter-variable represents the decoding-context inferred from the input image to diversify the poem themes; the guider-variable is introduced as an attribute decoder to restricts the word-choice with supervised information. Extensive experiments on automatic evaluations and human judgments demonstrate the superior performance of DG-Net than existing poem generation methods. Qualitative study show that our model can generate diverse poems with the poeticness and relevance.

Ask Lune

Know where this paper stands in minutes, not an afternoon.

Lune can read the top-tier papers that cite it and the ones closest to it, and tells you what it claims, what came after and where it falls short, each point cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

its abstract · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. R3Net: Relation-embedded Representation Reconstruction Network for Change CaptioningYunbin Tu, Liang Li, Chenggang Yan, Shengxiang Gao et al.EMNLP 2021 · 21 citations

Related papers

  1. MixPoet: Diverse Poetry Generation via Learning Controllable Mixed Latent SpaceXiaoyuan Yi, Ruoyu Li, Cheng Yang, Wenhao Li et al.AAAI 2020 · 41 citations
  2. Automatic Poetry Generation from Prosaic TextTim Van de CruysACL 2020 · 54 citations
  3. POEMetric: The Last Stanza of HumanityBingru Li, Han Wang, Hazel WilkinsonICLR 2026 · 2 citations
  4. POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image GenerationEvans Xu Han, Alice Qian Zhang, Haiyi Zhu, Hong Shen et al.UIST 2025 · 5 citations
  5. Hierarchical Scene Graph Encoder-Decoder for Image Paragraph CaptioningXu Yang, Chongyang Gao, Hanwang Zhang, Jianfei CaiACM MM 2020 · 25 citations
Dusk over the sea between two cliffs drawn in fine vertical lines