Lune

ASE2025Top-tier venue

United We Stand: Towards End-to-End Log-based Fault Diagnosis via Interactive Multi-Task Learning

Minghua He, Chiming Duan, Pei Xiao, Tong Jia, Siyu Yu, Lingzhe Zhang, Weijie Hong, Jin Han, Yifan Wu, Ying Li, Gang Huang

Abstract

Log-based fault diagnosis is essential for maintaining software system availability. However, existing fault diagnosis methods are built using a task-independent manner, which fails to bridge the gap between anomaly detection and root cause localization in terms of data form and diagnostic objectives, resulting in three major issues: 1) Diagnostic bias accumulates in the system; 2) System deployment relies on expensive monitoring data; 3) The collaborative relationship between diagnostic tasks is overlooked. Facing this problems, we propose a novel end-to-end log-based fault diagnosis method, Chimera, whose key idea is to achieve end-to-end fault diagnosis through bidirectional interaction and knowledge transfer between anomaly detection and root cause localization. Chimera is based on interactive multitask learning, carefully designing interaction strategies between anomaly detection and root cause localization at the data, feature, and diagnostic result levels, thereby achieving both sub-tasks interactively within a unified end-to-end framework. Evaluation on two public datasets and one industrial dataset shows that Chimera outperforms existing methods in both anomaly detection and root cause localization, achieving improvements of over 2.92% 5.00% and 19.01% 37.09%, respectively. It has been successfully deployed in production, serving an industrial cloud platform.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Log-based Anomaly Detection with Deep Learning: How Far Are We? cites Semi-supervised Log-based Anomaly Detection via Probabilistic Label Estimation
  • Log-based Anomaly Detection with Deep Learning: How Far Are We? cites Log-based Anomaly Detection Without Log Parsing
  • Semi-supervised Log-based Anomaly Detection via Probabilistic Label Estimation cites DeepLog: Anomaly Detection and Diagnosis from System Logs through Deep Learning
  • Log-based Anomaly Detection Without Log Parsing cites DeepLog: Anomaly Detection and Diagnosis from System Logs through Deep Learning
Builds onCited byLeft to right by year; the more cited, the higher.

Builds on24

  1. DeepLog: Anomaly Detection and Diagnosis from System Logs through Deep LearningMin Du, Feifei Li, Guineng Zheng, Vivek SrikumarCCS 2017 · 1,823 citations
  2. Which Tasks Should Be Learned Together in Multi-task Learning?Trevor Standley, Amir Zamir, Dawn Chen, Leonidas J. Guibas et al.ICML 2020 · 651 citations
  3. Log-based Anomaly Detection Without Log ParsingVan-Hoang Le, Hongyu ZhangASE 2021 · 249 citations
  4. Semi-supervised Log-based Anomaly Detection via Probabilistic Label EstimationLin Yang, Junjie Chen, Zan Wang, Weijing Wang et al.ICSE 2021 · 216 citations
  5. Log-based Anomaly Detection with Deep Learning: How Far Are We?Van-Hoang Le, Hongyu ZhangICSE 2022 · 212 citations

Related papers

  1. Eadro: An End-to-End Troubleshooting Framework for Microservices on Multi-source DataCheryl Lee, Tianyi Yang, Zhuangbin Chen, Yuxin Su et al.ICSE 2023 · 99 citations
  2. Nezha: Interpretable Fine-Grained Root Causes Analysis for Microservices on Multi-modal Observability DataGuangba Yu, Pengfei Chen, Yufeng Li, Hongyang Chen et al.FSE 2023 · 131 citations
  3. MetaRCA: A Generalizable Root Cause Analysis Framework for Cloud-Native Systems Powered by Meta Causal KnowledgeShuai Liang, Pengfei Chen, Bozhe Tian, Gou Tan et al.FSE 2026 · 4 citations
  4. LogAction: Consistent Cross-system Anomaly Detection through Logs via Active Domain AdaptationChiming Duan, Minghua He, Pei Xiao, Tong Jia et al.ASE 2025 · 6 citations
  5. ART: A Unified Unsupervised Framework for Incident Management in Microservice SystemsYongqian Sun, Binpeng Shi, Mingyu Mao, Minghua Ma et al.ASE 2024 · 9 citations
Dusk over the sea between two cliffs drawn in fine vertical lines