Making Disk Failure Predictions SMARTer!
Sidi Lu, Bing Luo, Tirthak Patel, Yongtao Yao, Devesh Tiwari, Weisong Shi
Abstract
Disk drives are one of the most commonly replaced hardware components and continue to pose challenges for accurate failure prediction. In this work, we present analysis and findings from one of the largest disk failure prediction studies covering a total of 380,000 hard drives over a period of two months across 64 sites of a large leading data center operator. Our proposed machine learning based models predict disk failures with 0.95 F-measure and 0.95 Matthews correlation coefficient (MCC) for 10-days prediction horizon on average.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b3841f30-89fd-47ba-92d2-6c7448a280e8Cited by top-tier papers12
- An In-Depth Study of Correlated Failures in Production SSD-Based Data CentersShujie Han, Patrick P. C. Lee, Fan Xu, Yi Liu et al.FAST 2021 · 54 citations
- NTAM: Neighborhood-Temporal Attention Model for Disk Failure Prediction in Cloud PlatformsChuan Luo, Pu Zhao, Bo Qiao, Youjiang Wu et al.WWW 2021 · 37 citations
- Predictive and Adaptive Failure Mitigation to Avert Production Cloud VM InterruptionsSebastien Levy, Randolph Yao, Youjiang Wu, Yingnong Dang et al.OSDI 2020 · 35 citations
- Boosting Full-Node Repair in Erasure-Coded StorageShiyao Lin, Guowen Gong, Zhirong Shen, Patrick P. C. Lee et al.USENIX ATC 2021 · 33 citations
- Multi-view Feature-based SSD Failure Prediction: What, When, and WhyYuqi Zhang, Wenwen Hao, Ben Niu, Kangkang Liu et al.FAST 2023 · 33 citations
Related papers
- HDDse: Enabling High-Dimensional Disk State Embedding for Generic Failure Detection System of Heterogeneous Disks in Large Data CentersJi Zhang, Ping Huang, Ke Zhou, Ming Xie et al.USENIX ATC 2020 · 20 citations
- MSFRD: Mutation Similarity based SSD Failure Rating and Diagnosis for Complex and Volatile Production EnvironmentsYuqi Zhang, Tianyi Zhang, Wenwen Hao, Shuyang Wang et al.USENIX ATC 2024 · 10 citations
- SEFEE: lightweight storage error forecasting in large-scale enterprise storage systemsAmirhessam Yazdi, Xing Lin, Lei Yang, Feng YanSC 2020 · 5 citations
- FailureMiner: A Joint Key Decision Mining Scheme for Practical SSD Failure Prediction and AnalysisShuyang Wang, Yuqi Zhang, Haonan Luo, Kangkang Liu et al.FAST 2026
- Perseus: A Fail-Slow Detection Framework for Cloud Storage SystemsRuiming Lu, Erci Xu, Yiming Zhang, Fengyi Zhu et al.FAST 2023 · 31 citations
