Unifying Symbolic Music Arrangement: Track-Aware Reconstruction and Structured Tokenization
Longshen Ou, Jingwei Zhao, Ziyu Wang, Gus Xia, Qihao Liang, Torin Hopkins, Ye Wang
Abstract
We present a unified framework for automatic multitrack music arrangement that enables a single pre-trained symbolic music model to handle diverse arrangement scenarios, including reinterpretation, simplification, and additive generation. At its core is a segment-level reconstruction objective operating on token-level disentangled content and style, allowing for flexible any-to-any instrumentation transformations at inference time. To support track-wise modeling, we introduce REMI-z, a structured tokenization scheme for multitrack symbolic music that enhances modeling efficiency and effectiveness for both arrangement tasks and unconditional generation. Our method outperforms task-specific state-of-the-art models on representative tasks in different arrangement scenarios -- band arrangement, piano reduction, and drum arrangement, in both objective metrics and perceptual evaluations. Taken together, our framework demonstrates strong generality and suggests broader applicability in symbolic music-to-music transformation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7d484e12-76fa-4586-b641-19be677f0bc0Builds on9
- Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano CompositionsYu-Siang Huang, Yi-Hsuan YangACM MM 2020 · 265 citations
- MT3: Multi-Task Multitrack Music TranscriptionJosh Gardner, Ian Simon, Ethan Manilow, Curtis Hawthorne et al.ICLR 2022 · 134 citations
- Encoding Musical Style with Transformer AutoencodersKristy Choi, Curtis Hawthorne, Ian Simon, Monica Dinculescu et al.ICML 2020 · 102 citations
- PopMAG: Pop Music Accompaniment GenerationYi Ren, Jinzheng He, Xu Tan, Tao Qin et al.ACM MM 2020 · 91 citations
- Whole-Song Hierarchical Generation of Symbolic Music Using Cascaded Diffusion ModelsZiyu Wang, Lejun Min, Gus XiaICLR 2024 · 32 citations
Related papers
- Structured Multi-Track Accompaniment Arrangement via Style Prior ModellingJingwei Zhao, Gus Xia, Ziyu Wang, Ye WangNeurIPS 2024 · 13 citations
- Bridging Piano Transcription and Rendering via Disentangled Score Content and StyleWei Zeng, Junchuan Zhao, Ye WangICLR 2026
- FIGARO: Controllable Music Generation using Learned and Expert FeaturesDimitri von Rütte, Luca Biggio, Yannic Kilcher, Thomas HofmannICLR 2023
- PiRhDy: Learning Pitch-, Rhythm-, and Dynamics-aware Embeddings for Symbolic MusicHongru Liang, Wenqiang Lei, Paul Yaozhu Chan, Zhenglu Yang et al.ACM MM 2020 · 23 citations
- Unaligned Supervision for Automatic Music Transcription in The WildBen Maman, Amit H. BermanoICML 2022 · 46 citations
