Time Series Generation Under Data Scarcity: A Unified Generative Modeling Approach
Tal Gonen, Itai Pemper, Ilan Naiman, Nimrod Berman, Omri Azencot
Abstract
Generative modeling of time series is a central challenge in time series analysis, particularly under data-scarce conditions. Despite recent advances in generative modeling, a comprehensive understanding of how state-of-the-art generative models perform under limited supervision remains lacking. In this work, we conduct the first large-scale study evaluating leading generative models in data-scarce settings, revealing a substantial performance gap between full-data and data-scarce regimes. To close this gap, we propose a unified diffusion-based generative framework that can synthesize high-fidelity time series across diverse domains using just a few examples. Our model is pre-trained on a large, heterogeneous collection of time series datasets, enabling it to learn generalizable temporal representations. It further incorporates architectural innovations such as dynamic convolutional layers for flexible channel adaptation and dataset token conditioning for domain-aware generation. Without requiring abundant supervision, our unified model achieves state-of-the-art performance in few-shot settings-outperforming domain-specific baselines across a wide range of subset sizes. Remarkably, it also surpasses all baselines even when tested on full datasets benchmarks, highlighting the strength of pre-training and cross-domain generalization. We hope this work encourages the community to revisit few-shot generative modeling as a key problem in time series research and pursue unified solutions that scale efficiently across domains. Code is available at https://github.com/azencot-group/ImagenFew .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 45c0f790-0a8c-469e-a501-3cdb681034eeCited by top-tier papers6
- A Diffusion Model for Regular Time Series Generation from Irregular Data with Completion and MaskingGal Fadlon, Idan Arbiv, Nimrod Berman, Omri AzencotNeurIPS 2025 · 12 citations
- One-Step Offline Distillation of Diffusion-based Models via Koopman ModelingNimrod Berman, Ilan Naiman, Moshe Eliasof, Hedi Zisling et al.NeurIPS 2025 · 10 citations
- Towards General Modality Translation with Contrastive and Predictive Latent Diffusion BridgeNimrod Berman, Omkar Joglekar, Eitan Kosman, Dotan Di Castro et al.NeurIPS 2025 · 5 citations
- DiffSDA: Unsupervised Diffusion Sequential Disentanglement Across ModalitiesHedi Zisling, Ilan Naiman, Nimrod Berman, Supasorn Suwajanakorn et al.ICLR 2026 · 2 citations
- Time Series Reasoning via Process-Verifiable Thinking Data Synthesis and Scheduling for Tailored LLM ReasoningJiahui Zhou, Dan Li, Boxin Li, Xiao Zhang et al.ICML 2026 · 1 citation
Builds on28
- Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah et al.NeurIPS 2020 · 64,255 citations
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu et al.ICLR 2022 · 18,833 citations
- Segment AnythingAlexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao et al.ICCV 2023 · 13,211 citations
Related papers
- Towards a Unified Generative Model for Scarce Time Series with Domain ExpertsZihao Yao, Qi Zheng, Jiankai Zuo, YAYING ZHANGICML 2026
- Utilizing Image Transforms and Diffusion Models for Generative Modeling of Short and Long Time SeriesIlan Naiman, Nimrod Berman, Itai Pemper, Idan Arbiv et al.NeurIPS 2024 · 69 citations
- Customizing GAN Using Few-shot SketchesSyed Muhammad Israr, Feng ZhaoACM MM 2022 · 4 citations
- TimeDP: Learning to Generate Multi-Domain Time Series with Domain PromptsYu-Hao Huang, Chang Xu, Yueying Wu, Wu-Jun Li et al.AAAI 2025 · 16 citations
- HYPDAE: Hyperbolic Diffusion Autoencoders for Hierarchical Few-Shot Image GenerationLingxiao Li, Kaixuan Fan, Boqing Gong, Xiangyu YueICCV 2025 · 5 citations
