Improving Private Random Forest Prediction Using Matrix Representation
Arisa Tajima, Joie Wu, Amir Houmansadr
Abstract
We introduce a novel matrix representation for differentially private training and prediction methods tailored to random forest classifiers. Our approach involves representing each root-to-leaf decision path in all trees as a row vector in a matrix. Similarly, inference queries are represented as a matrix. This representation enables us to collectively analyze privacy across multiple trees and inference queries, resulting in optimal DP noise allocation under the Laplace Mechanism. Our experimental results show significant accuracy improvements of up to 40% compared to state-of-the-art methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 812e25fc-ba0b-42e1-8b2b-b2f8e2ec298bBuilds on4
- Deep Learning with Differential PrivacyMartín Abadi, Andy Chu, Ian J. Goodfellow, H. Brendan McMahan et al.CCS 2016 · 7,620 citations
- Membership Inference Attacks Against Machine Learning ModelsReza Shokri, Marco Stronati, Congzheng Song, Vitaly ShmatikovS&P 2017 · 5,137 citations
- Evaluating Differentially Private Machine Learning in PracticeBargav Jayaraman, David EvansUSENIX Security 2019 · 586 citations
- Federated Boosted Decision Trees with Differential PrivacySamuel Maddock, Graham Cormode, Tianhao Wang, Carsten Maple et al.CCS 2022 · 31 citations
Related papers
- Privacy-Preserving Gradient Boosting Decision TreesQinbin Li, Zhaomin Wu, Zeyi Wen, Bingsheng HeAAAI 2020 · 87 citations
- PrivateFL: Accurate, Differentially Private Federated Learning via Personalized Data TransformationYuchen Yang, Bo Hui, Haolin Yuan, Neil Zhenqiang Gong et al.USENIX Security 2023
- Correlated Noise Provably Beats Independent Noise for Differentially Private LearningChristopher A. Choquette-Choo, Krishnamurthy Dj Dvijotham, Krishna Pillutla, Arun Ganesh et al.ICLR 2024 · 27 citations
- Enhancing Learning with Label Differential Privacy by Vector ApproximationPuning Zhao, Jiafei Wu, Zhe Liu, Li Shen et al.ICLR 2025
- Differentially Private Sparse Vectors with Low Error, Optimal Space, and Fast AccessMartin Aumüller, Christian Janos Lebeda, Rasmus PaghCCS 2021
