AutoCut: End-to-end advertisement video editing based on multimodal discretization and controllable generation
Milton Zhou, Sizhong Qin, Yongzhi Li, Quan Chen, Peng Jiang
Abstract
Short-form videos have become a primary medium for digital advertising, requiring scalable and efficient content creation. However, current workflows and AI tools remain disjoint and modality-specific, leading to high production costs and low overall efficiency. To address this issue, we propose AutoCut, an end-to-end advertisement video editing framework based on multimodal discretization and controllable editing. AutoCut employs dedicated encoders to extract video and audio features, then applies residual vector quantization to discretize them into unified tokens aligned with textual representations, constructing a shared video-audio-text token space. Built upon a foundation model, we further develop a multimodal large language model for video editing through combined multimodal alignment and supervised fine-tuning, supporting tasks covering video selection and ordering, script generation, and background music selection within a unified editing framework. Finally, a complete production pipeline converts the predicted token sequences into deployable long video outputs. Experiments on real-world advertisement datasets show that AutoCut reduces production cost and iteration time while substantially improving consistency and controllability, paving the way for scalable video creation.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d6c688a8-9044-48ea-955f-875b61f323fbBuilds on14
- SlowFast Networks for Video RecognitionChristoph Feichtenhofer, Haoqi Fan, Jitendra Malik, Kaiming HeICCV 2019 · 4,104 citations
- Autoregressive Image Generation using Residual QuantizationDoyup Lee, Chiheon Kim, Saehoon Kim, Minsu Cho et al.CVPR 2022 · 184 citations
- UniVideo: Unified Understanding, Generation, and Editing for VideosCong Wei, Quande Liu, Zixuan Ye, Qiulin Wang et al.ICLR 2026 · 90 citations
- ReelFramer: Human-AI Co-Creation for News-to-Video TranslationSitong Wang, Samia Menon, Tao Long, Keren Henderson et al.CHI 2024 · 47 citations
- Unified In-Context Video EditingZixuan Ye, Xuanhua He, Quande Liu, Qiulin Wang et al.ICLR 2026 · 37 citations
Related papers
- Video-LaVIT: Unified Video-Language Pre-training with Decoupled Visual-Motional TokenizationYang Jin, Zhicheng Sun, Kun Xu, Kun Xu et al.ICML 2024 · 94 citations
- REGen: Multimodal Retrieval-Embedded Generation for Long-to-Short Video EditingWeihan Xu, Yimeng Ma, Jingyue Huang, Yang Li et al.NeurIPS 2025 · 1 citation
- ALTo: Adaptive-Length Tokenizer for Autoregressive Mask GenerationLingfeng Wang, Hualing Lin, Senda Chen, Tao Wang et al.NeurIPS 2025 · 5 citations
- AccKV: Towards Efficient Audio-Video LLMs Inference via Adaptive-Focusing and Cross-Calibration KV Cache OptimizationZhonghua Jiang, Kui Chen, Kunxi Li, Keting Yin et al.AAAI 2026 · 4 citations
- The Devil is in Temporal Token: High Quality Video Reasoning SegmentationSitong Gong, Yunzhi Zhuge, Lu Zhang, Zongxin Yang et al.CVPR 2025
