Parametric Scattering Networks
Shanel Gauthier, Benjamin Thérien, Laurent Alsène-Racicot, Muawiz Chaudhary, Irina Rish, Eugene Belilovsky, Michael Eickenberg, Guy Wolf
摘要
The wavelet scattering transform creates geometric in-variants and deformation stability. In multiple signal do-mains, it has been shown to yield more discriminative rep-resentations compared to other non-learned representations and to outperform learned representations in certain tasks, particularly on limited labeled data and highly structured signals. The wavelet filters used in the scattering trans-form are typically selected to create a tight frame via a pa-rameterized mother wavelet. In this work, we investigate whether this standard wavelet filterbank construction is op-timal. Focusing on Morlet wavelets, we propose to learn the scales, orientations, and aspect ratios of the filters to produce problem-specific parameterizations of the scattering transform. We show that our learned versions of the scattering transform yield significant performance gains in small-sample classification settings over the standard scat-tering transform. Moreover, our empirical results suggest that traditional filterbank constructions may not always be necessary for scattering transforms to extract effective rep-resentations.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Neural Fourier Filter BankZhijie Wu, Yuhe Jin, Kwang Moo YiCVPR 2023
- SCRAPL: Scattering Transform with Random Paths for Machine LearningChristopher Mitcheltree, Vincent Lostanlen, Emmanouil Benetos, Mathieu LagrangeICLR 2026
它引用的顶会 Paper3
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 被引用 24,064 次
- Learnable Group Transform For Time-SeriesRomain Cosentino, Behnaam AazhangICML 2020 · 被引用 14 次
- On Translation Invariance in CNNs: Convolutional Layers Can Exploit Absolute Spatial LocationOsman Semih Kayhan, Jan C. van GemertCVPR 2020
相关 Paper
- Separation and Concentration in Deep NetworksJohn Zarka, Florentin Guth, Stéphane MallatICLR 2021 · 被引用 36 次
- Deep Network Classification by Scattering and Homotopy Dictionary LearningJohn Zarka, Louis Thiry, Tomás Angles, Stéphane MallatICLR 2020 · 被引用 43 次
- Spatio-Temporal Graph Scattering TransformChao Pan, Siheng Chen, Antonio OrtegaICLR 2021 · 被引用 30 次
- Graph Scattering beyond Wavelet ShacklesChristian Koke, Gitta KutyniokNeurIPS 2022 · 被引用 9 次
- Feature Directions Matter: Long-Tailed Learning via Rotated Balanced RepresentationPeifeng Gao, Qianqian Xu, Peisong Wen, Zhiyong Yang 等ICML 2023 · 被引用 26 次
