Lattice partition recovery with dyadic CART
Oscar Hernan Madrid Padilla, Yi Yu, Alessandro Rinaldo
Abstract
We study piece-wise constant signals corrupted by additive Gaussian noise over a -dimensional lattice. Data of this form naturally arise in a host of applications, and the tasks of signal detection or testing, de-noising and estimation have been studied extensively in the statistical and signal processing literature. In this paper we consider instead the problem of partition recovery, i.e. of estimating the partition of the lattice induced by the constancy regions of the unknown signal, using the computationally-efficient dyadic classification and regression tree (DCART) methodology proposed by . We prove that, under appropriate regularity conditions on the shape of the partition elements, a DCART-based procedure consistently estimates the underlying partition at a rate of order , where is the minimal number of rectangular sub-graphs obtained using recursive dyadic partitions supporting the signal partition, is the noise variance, is the minimal magnitude of the signal difference among contiguous elements of the partition and is the size of the lattice. Furthermore, under stronger assumptions, our method attains a sharper estimation error of order , independent of , which we show to be minimax rate optimal. Our theoretical guarantees further extend to the partition estimator based on the optimal regression tree estimator (ORT) of and to the one obtained through an NP-hard exhaustive search method. We corroborate our theoretical findings and the effectiveness of DCART for partition recovery in simulations.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Related papers
- Coresets for Decision Trees of SignalsIbrahim Jubran, Ernesto Evgeniy Sanches Shayda, Ilan Newman, Dan FeldmanNeurIPS 2021 · 23 citations
- Sparse Learning with CARTJason M. KlusowskiNeurIPS 2020 · 31 citations
- Approximating Maximum Independent Set for Rectangles in the PlaneJoseph S. B. MitchellFOCS 2021 · 18 citations
- Piecewise Constant and Linear Regression Trees: An Optimal Dynamic Programming ApproachMim van den Bos, Jacobus G. M. van der Linden, Emir DemirovicICML 2024 · 6 citations
- The Influence of Dimensions on the Complexity of Computing Decision TreesStephen G. Kobourov, Maarten Löffler, Fabrizio Montecchiani, Marcin Pilipczuk et al.AAAI 2023 · 14 citations
