Parametric Scattering Networks
Shanel Gauthier, Benjamin Thérien, Laurent Alsène-Racicot, Muawiz Chaudhary, Irina Rish, Eugene Belilovsky, Michael Eickenberg, Guy Wolf
Abstract
The wavelet scattering transform creates geometric in-variants and deformation stability. In multiple signal do-mains, it has been shown to yield more discriminative rep-resentations compared to other non-learned representations and to outperform learned representations in certain tasks, particularly on limited labeled data and highly structured signals. The wavelet filters used in the scattering trans-form are typically selected to create a tight frame via a pa-rameterized mother wavelet. In this work, we investigate whether this standard wavelet filterbank construction is op-timal. Focusing on Morlet wavelets, we propose to learn the scales, orientations, and aspect ratios of the filters to produce problem-specific parameterizations of the scattering transform. We show that our learned versions of the scattering transform yield significant performance gains in small-sample classification settings over the standard scat-tering transform. Moreover, our empirical results suggest that traditional filterbank constructions may not always be necessary for scattering transforms to extract effective rep-resentations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers2
- Neural Fourier Filter BankZhijie Wu, Yuhe Jin, Kwang Moo YiCVPR 2023
- SCRAPL: Scattering Transform with Random Paths for Machine LearningChristopher Mitcheltree, Vincent Lostanlen, Emmanouil Benetos, Mathieu LagrangeICLR 2026
Builds on3
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Learnable Group Transform For Time-SeriesRomain Cosentino, Behnaam AazhangICML 2020 · 14 citations
- On Translation Invariance in CNNs: Convolutional Layers Can Exploit Absolute Spatial LocationOsman Semih Kayhan, Jan C. van GemertCVPR 2020
Related papers
- Separation and Concentration in Deep NetworksJohn Zarka, Florentin Guth, Stéphane MallatICLR 2021 · 36 citations
- Deep Network Classification by Scattering and Homotopy Dictionary LearningJohn Zarka, Louis Thiry, Tomás Angles, Stéphane MallatICLR 2020 · 43 citations
- Spatio-Temporal Graph Scattering TransformChao Pan, Siheng Chen, Antonio OrtegaICLR 2021 · 30 citations
- Graph Scattering beyond Wavelet ShacklesChristian Koke, Gitta KutyniokNeurIPS 2022 · 9 citations
- Feature Directions Matter: Long-Tailed Learning via Rotated Balanced RepresentationPeifeng Gao, Qianqian Xu, Peisong Wen, Zhiyong Yang et al.ICML 2023 · 26 citations
