Lune

ACL Findings2023

SongRewriter: A Chinese Song Rewriting System with Controllable Content and Rhyme Scheme

Yusen Sun, Liangyou Li, Qun Liu, Dit-Yan Yeung

Abstract

Although lyrics generation has achieved significant progress in recent years, it has limited practical applications because the generated lyrics cannot be performed without composing compatible melodies. In this work, we bridge this practical gap by proposing a song rewriting system which rewrites the lyrics of an existing song such that the generated lyrics are compatible with the rhythm of the existing melody and thus singable. In particular, we propose SongRewriter, 1 a controllable Chinese lyrics generation and editing system which assists users without prior knowledge of melody composition. The system is trained by a randomized multi-level masking strategy which produces a unified model for generating entirely new lyrics or editing a few fragments. To improve the controllabiliy of the generation process, we further incorporate a keyword prompt to control the lexical choices of the content and propose novel decoding constraints and a vowel modeling task to enable flexible end and internal rhyme schemes. While prior rhyming metrics are mainly for rap lyrics, we propose three novel rhyming evaluation metrics for song lyrics. Both automatic and human evaluations show that the proposed model performs better than the state-of-the-art models in both contents and rhyming quality.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

3 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • ToneCraft: Cantonese Lyrics Generation with Harmony of Tones and Pitches cites AI-Lyricist: Generating Music and Vocabulary Constrained Lyrics
  • ToneCraft: Cantonese Lyrics Generation with Harmony of Tones and Pitches cites Rigid Formats Controlled Text Generation
  • ToneCraft: Cantonese Lyrics Generation with Harmony of Tones and Pitches cites SongMASS: Automatic Song Writing with Pre-training and Alignment Constraint
  • SongMASS: Automatic Song Writing with Pre-training and Alignment Constraint cites Rigid Formats Controlled Text Generation
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers3

  1. A Design Space for Intelligent and Interactive Writing AssistantsMina Lee, Katy Ilonka Gero, John Joon Young Chung, Simon Buckingham Shum et al.CHI 2024 · 133 citations
  2. ToneCraft: Cantonese Lyrics Generation with Harmony of Tones and PitchesJunyu Cheng, Chang Pan, Shuangyin LiEMNLP 2025
  3. Phun-Bench: Evaluating LLMs on Phonological Understanding in ChineseXing Yue, Yongliang Shen, Weiming LuACL 2026

Builds on6

  1. The Curious Case of Neural Text DegenerationAri Holtzman, Jan Buys, Li Du, Maxwell Forbes et al.ICLR 2020 · 4,112 citations
  2. SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenEMNLP 2021 · 2,496 citations
  3. SongMASS: Automatic Song Writing with Pre-training and Alignment ConstraintZhonghao Sheng, Kaitao Song, Xu Tan, Yi Ren et al.AAAI 2021 · 84 citations
  4. AI-Lyricist: Generating Music and Vocabulary Constrained LyricsXichu Ma, Ye Wang, Min-Yen Kan, Wee Sun LeeACM MM 2021 · 22 citations
  5. Rigid Formats Controlled Text GenerationPiji Li, Haisong Zhang, Xiaojiang Liu, Shuming ShiACL 2020 · 2 citations

Related papers

  1. Unsupervised Melody-to-Lyrics GenerationYufei Tian, Anjali Narayan-Chen, Shereen Oraby, Alessandra Cervone et al.ACL 2023 · 6 citations
  2. Songs Across Borders: Singable and Controllable Neural Lyric TranslationLongshen Ou, Xichu Ma, Min-Yen Kan, Ye WangACL 2023 · 3 citations
  3. SongComposer: A Large Language Model for Lyric and Melody Generation in Song CompositionShuangrui Ding, Zihan Liu, Xiaoyi Dong, Pan Zhang et al.ACL 2025
  4. ReLyMe: Improving Lyric-to-Melody Generation by Incorporating Lyric-Melody RelationshipsChen Zhang, LuChin Chang, Songruoyao Wu, Xu Tan et al.ACM MM 2022 · 13 citations
  5. Automatic Song Translation for Tonal LanguagesFenfei Guo, Chen Zhang, Zhirui Zhang, Qixin He et al.ACL Findings 2022 · 6 citations
Dusk over the sea between two cliffs drawn in fine vertical lines