AutoCut: End-to-end advertisement video editing based on multimodal discretization and controllable generation
Milton Zhou, Sizhong Qin, Yongzhi Li, Quan Chen, Peng Jiang
摘要
Short-form videos have become a primary medium for digital advertising, requiring scalable and efficient content creation. However, current workflows and AI tools remain disjoint and modality-specific, leading to high production costs and low overall efficiency. To address this issue, we propose AutoCut, an end-to-end advertisement video editing framework based on multimodal discretization and controllable editing. AutoCut employs dedicated encoders to extract video and audio features, then applies residual vector quantization to discretize them into unified tokens aligned with textual representations, constructing a shared video-audio-text token space. Built upon a foundation model, we further develop a multimodal large language model for video editing through combined multimodal alignment and supervised fine-tuning, supporting tasks covering video selection and ordering, script generation, and background music selection within a unified editing framework. Finally, a complete production pipeline converts the predicted token sequences into deployable long video outputs. Experiments on real-world advertisement datasets show that AutoCut reduces production cost and iteration time while substantially improving consistency and controllability, paving the way for scalable video creation.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper14
- SlowFast Networks for Video RecognitionChristoph Feichtenhofer, Haoqi Fan, Jitendra Malik, Kaiming HeICCV 2019 · 被引用 4,104 次
- Autoregressive Image Generation using Residual QuantizationDoyup Lee, Chiheon Kim, Saehoon Kim, Minsu Cho 等CVPR 2022 · 被引用 184 次
- UniVideo: Unified Understanding, Generation, and Editing for VideosCong Wei, Quande Liu, Zixuan Ye, Qiulin Wang 等ICLR 2026 · 被引用 90 次
- ReelFramer: Human-AI Co-Creation for News-to-Video TranslationSitong Wang, Samia Menon, Tao Long, Keren Henderson 等CHI 2024 · 被引用 47 次
- Unified In-Context Video EditingZixuan Ye, Xuanhua He, Quande Liu, Qiulin Wang 等ICLR 2026 · 被引用 37 次
相关 Paper
- Video-LaVIT: Unified Video-Language Pre-training with Decoupled Visual-Motional TokenizationYang Jin, Zhicheng Sun, Kun Xu, Kun Xu 等ICML 2024 · 被引用 94 次
- REGen: Multimodal Retrieval-Embedded Generation for Long-to-Short Video EditingWeihan Xu, Yimeng Ma, Jingyue Huang, Yang Li 等NeurIPS 2025 · 被引用 1 次
- ALTo: Adaptive-Length Tokenizer for Autoregressive Mask GenerationLingfeng Wang, Hualing Lin, Senda Chen, Tao Wang 等NeurIPS 2025 · 被引用 5 次
- AccKV: Towards Efficient Audio-Video LLMs Inference via Adaptive-Focusing and Cross-Calibration KV Cache OptimizationZhonghua Jiang, Kui Chen, Kunxi Li, Keting Yin 等AAAI 2026 · 被引用 4 次
- The Devil is in Temporal Token: High Quality Video Reasoning SegmentationSitong Gong, Yunzhi Zhuge, Lu Zhang, Zongxin Yang 等CVPR 2025
