Lune

ICML2026Top-tier venue

Towards Trustworthy Video Anomaly Understanding: A Class-Guided Chain-of-Evaluation Metric and An Anomaly-focused Meta-Benchmark

Jiaxu Leng, Zhoujie Huang, Mingpi Tan, Zhanjie Wu, Xinbo Gao

2026Year

Abstract

The trustworthiness of evaluation is critical to reliable model comparison and deployment in Video Anomaly Understanding (VAU). However, existing metrics are sensitive to expression styles and normal content, and this field lacks a diagnostic benchmark to validate metric validity and robustness. To bridge this gap, we propose: (1) a Class-Guided Chain-of-Evaluation (CG-CoE) metric, which structures assessment by extracting anomalous events and matching them under a class-specific semantic tolerance boundary, thereby decoupling anomaly semantics from expression styles; and (2) an anomaly-focused metaevaluation benchmark with two subsets: Anomalous Event-level Annotations (AEA) subset for measuring the validity of reflecting VAU models' anomaly understanding ability and Controlled Variant Pairs (CVP) with fixed anomalies for quantifying robustness to stylistic perturbations. Extensive experiments demonstrate that CG-CoE achieves state-of-the-art (SOTA) validity and robustness.

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

Builds on15

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines