TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentation
Samuel G. Müller, Frank Hutter
Abstract
Automatic augmentation methods have recently become a crucial pillar for strong model performance in vision tasks. While existing automatic augmentation methods need to trade off simplicity, cost and performance, we present a most simple baseline, TrivialAugment, that outperforms previous methods for almost free. TrivialAugment is parameter-free and only applies a single augmentation to each image. Thus, TrivialAugment's effectiveness is very unexpected to us and we performed very thorough experiments to study its performance. First, we compare Triv-ialAugment to previous state-of-the-art methods in a variety of image classification scenarios. Then, we perform multiple ablation studies with different augmentation spaces, augmentation methods and setups to understand the crucial requirements for its performance. Additionally, we provide a simple interface to facilitate the widespread adoption of automatic augmentation methods, as well as our full code base for reproducibility 1 . Since our work reveals a stagnation in many parts of automatic augmentation research, we end with a short proposal of best practices for sustained future progress in automatic augmentation methods. Sample strength Input image Sample augmentation and apply it 1.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext ff6a106f-b05c-4ac9-a7f0-249e6c65062aCited by top-tier papers62
- Well-tuned Simple Nets Excel on Tabular DatasetsArlind Kadra, Marius Lindauer, Frank Hutter, Josif GrabockaNeurIPS 2021 · 288 citations
- An Empirical Study of CLIP for Text-Based Person SearchMin Cao, Yang Bai, Ziyin Zeng, Mang Ye et al.AAAI 2024 · 111 citations
- Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term DependenciesWei Fang, Zhaofei Yu, Zhaokun Zhou, Ding Chen et al.NeurIPS 2023 · 104 citations
- TeachAugment: Data Augmentation Optimization Using Teacher KnowledgeTeppei SuzukiCVPR 2022 · 57 citations
- Simplifying Neural Network Training Under Class ImbalanceRavid Shwartz-Ziv, Micah Goldblum, Yucen Lily Li, C. Bayan Bruss et al.NeurIPS 2023 · 45 citations
Builds on7
- RandAugment: Practical Automated Data Augmentation with a Reduced Search SpaceEkin Dogus Cubuk, Barret Zoph, Jonathon Shlens, Quoc LeNeurIPS 2020 · 4,453 citations
- Unsupervised Data Augmentation for Consistency TrainingQizhe Xie, Zihang Dai, Eduard H. Hovy, Thang Luong et al.NeurIPS 2020 · 2,774 citations
- AugMix: A Simple Data Processing Method to Improve Robustness and UncertaintyDan Hendrycks, Norman Mu, Ekin Dogus Cubuk, Barret Zoph et al.ICLR 2020 · 1,572 citations
- Adversarial AutoAugmentXinyu Zhang, Qiang Wang, Jian Zhang, Zhao ZhongICLR 2020 · 210 citations
- Online Hyper-Parameter Learning for Auto-Augmentation StrategyChen Lin, Minghao Guo, Chuming Li, Xin Yuan et al.ICCV 2019 · 92 citations
Related papers
- Enhancing Visual Prompting through Expanded Transformation Space and Overfitting MitigationShohei EnomotoNeurIPS 2025 · 1 citation
- Frozen Feature Augmentation for Few-Shot Image ClassificationAndreas Bär, Neil Houlsby, Mostafa Dehghani, Manoj KumarCVPR 2024
- Tied-Augment: Controlling Representation Similarity Improves Data AugmentationEmirhan Kurtulus, Zichao Li, Yann N. Dauphin, Ekin Dogus CubukICML 2023 · 5 citations
- AdaAug: Learning Class- and Instance-adaptive Data Augmentation PoliciesTsz-Him Cheung, Dit-Yan YeungICLR 2022 · 31 citations
- Augmentation Matters: A Simple-Yet-Effective Approach to Semi-Supervised Semantic SegmentationZhen Zhao, Lihe Yang, Sifan Long, Jimin Pi et al.CVPR 2023
