Few-shot Multimodal Anomaly Detection via Dynamic Intra-modal Sparsity Attention and Quality-aware Cross-modal Fusion in Microservice System
Kaiqi Ding, Zijian Song, Kaigui Bian
Abstract
The dynamic nature of microservice architectures necessitates robust few-shot anomaly detection (AD) systems to prevent cascading failures. However, current multimodal approaches remain inadequate for cold-start scenarios due to their dependence on extensive training data. The fundamental challenge in few-shot AD lies in two critical aspects: (1) effective feature extraction from intra-modalities, and (2) the alignment of heterogeneous multimodal representations, particularly the distribution discrepancy between discrete token embeddings from logs and continuously evolving representations from traces and metrics. To overcome these challenges, we present FuseGuard, an LLM-enhanced framework that pioneers quality-aware multimodal fusion for few-shot AD. First, our intra-modal feature extraction employs a Dynamic Sparse Correlation Attention mechanism for metrics, Spatio-temporal Encoding for traces, and LLM-enhanced semantic-frequency encoding for logs, enabling adaptive representation of time-evolving patterns. Second, we introduce hierarchical cross-modal alignment via token projection, layer-wise distillation, and consistency learning to preserve modality-specific features while enabling effective knowledge transfer. Finally, a quality-aware fusion mechanism dynamically weights modalities based on uncertainty estimation. Evaluated on three open-source platforms (MSDS, GAIA, TrainTicket) and a production system, FuseGuard's few-shot capability outperforms SOTA by 19.69%-77.07% F1-score across four datasets.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 07c14c89-dae6-454b-9a2c-c7c1371fcf6eRelated papers
- Twin Graph-Based Anomaly Detection via Attentive Multi-Modal Learning for Microservice SystemJun Huang, Yang Yang, Hang Yu, Jianguo Li et al.ASE 2023 · 32 citations
- Famos: Fault Diagnosis for Microservice Systems Through Effective Multi-Modal Data FusionChiming Duan, Yong Yang, Tong Jia, Guiyang Liu et al.ICSE 2025 · 3 citations
- Enhancing Microservices Anomaly Detection via Multimodal Data Fusion in the Wavelet Domain and Spatiotemporal Graph-based Diffusion Probabilistic ModelKaiqi Ding, Yuanmu Ma, Zijian Song, Kaigui BianKDD 2025
- DyLogNet: A Dynamic Multi-Relational Graph Framework for Log Anomaly DetectionXudong Zhao, Xiaolong Xu, Haolong Xiang, Tong Gao et al.WWW 2026
- FIND: Few-Shot Anomaly Inspection with Normal-Only Multi-Modal DataYiting Li, Fayao Liu, Jingyi Liao, Sichao Tian et al.ICCV 2025 · 5 citations
