DBCatcher: A Cloud Database Online Anomaly Detection System based on Indicator Correlation
Guangyu Zhang, Chunhua Li, Ke Zhou, Li Liu, Ce Zhang, Wancheng Chen, Haotian Fang, Bin Cheng, Jie Yang, Jiashu Xing
Abstract
Anomaly detection system plays an important role in maintaining the stability of cloud database. Existing studies mainly focus on significant deviations in multivariate time series, such as a combination of CPU utilization, transactions per second, etc, to detect abnormal issues. Due to the complexity of cloud database structure and functions, these approaches are difficult to achieve a balance among detection performance, detection efficiency and workload adaptability. In this paper, we propose DBCatcher, a cloud database online anomaly detection system based on indicator correlation. Through extensive analysis of real-world cloud database time series, we find the correlations among trends in the same key performance indicators across databases within the same unit, which inspires us to explore a time series correlation measurement method that can efficiently detect abnormal issues. Meanwhile, we design a flexible time window observation mechanism and an adaptive threshold learning policy to minimize misjudgment caused by key performance indicator fluctuations, greatly enhancing the detection performance and workload adaptability. We conduct extensive experiments under real-world and synthetic workloads. Experimental results show that DBCatcher significantly improves the detection performance and detection efficiency compared to existing methods.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Cited by top-tier papers1
Ask how each one uses itRelated papers
- Adaptive Performance Anomaly Detection for Online Service Systems via Pattern SketchingZhuangbin Chen, Jinyang Liu, Yuxin Su, Hongyu Zhang et al.ICSE 2022 · 44 citations
- A Stitch in Time Saves Nine: Enabling Early Anomaly Detection with Correlation AnalysisYihao Ang, Qiang Huang, Anthony K. H. Tung, Zhiyong HuangICDE 2023 · 6 citations
- Jump-Starting Multivariate Time Series Anomaly Detection for Online Service SystemsMinghua Ma, Shenglin Zhang, Junjie Chen, Jim Xu et al.USENIX ATC 2021 · 97 citations
- Multivariate Log-based Anomaly Detection for Distributed DatabaseLingzhe Zhang, Tong Jia, Mengxi Jia, Ying Li et al.KDD 2024 · 13 citations
- DBPA: A Benchmark for Transactional Database Performance AnomaliesShiyue Huang, Ziwei Wang, Xinyi Zhang, Yaofeng Tu et al.SIGMOD 2023 · 8 citations
