Multispectral Video Semantic Segmentation: A Benchmark Dataset and Baseline
Wei Ji, Jingjing Li, Cheng Bian, Zongwei Zhou, Jiaying Zhao, Alan L. Yuille, Li Cheng
2023Year
15Top-tier citations
Abstract
github.io/Multispectral-Video-Semantic-Segmentation KAIST_set03_V000_2.-2 RGBT234_man9 KAIST_set02_V004_1.-3 Figure 1. Multispectral Video Semantic Segmentation. Examples of three typical real-life video sequences under diverse conditions are given (daytime (left), nighttime and overexposure (middle), rainy and low-light (right)), where RGB images, thermal infrared images, and their pixel-level semantic annotations are shown through the first to the third rows, respectively.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers15
- Learning Frequency-Adapted Vision Foundation Model for Domain Generalized Semantic SegmentationQi Bi, Jingjun Yi, Hao Zheng, Haolan Zhan et al.NeurIPS 2024 · 62 citations
- Learning Spectral-Decomposited Tokens for Domain Generalized Semantic SegmentationJingjun Yi, Qi Bi, Hao Zheng, Haolan Zhan et al.ACM MM 2024 · 25 citations
- Spider: A Unified Framework for Context-dependent Concept SegmentationXiaoqi Zhao, Youwei Pang, Wei Ji, Baicheng Sheng et al.ICML 2024 · 21 citations
- Size-invariance Matters: Rethinking Metrics and Losses for Imbalanced Multi-object Salient Object DetectionFeiran Li, Qianqian Xu, Shilong Bao, Zhiyong Yang et al.ICML 2024 · 18 citations
- MoniTor: Exploiting Large Language Models with Instruction for Online Video Anomaly DetectionShengtian Yang, Yue Feng, Yingshi Liu, Jingrou Zhang et al.NeurIPS 2025 · 16 citations
Builds on22
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- SegFormer: Simple and Efficient Design for Semantic Segmentation with TransformersEnze Xie, Wenhai Wang, Zhiding Yu, Anima Anandkumar et al.NeurIPS 2021 · 9,661 citations
- Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without ConvolutionsWenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan et al.ICCV 2021 · 4,909 citations
- CCNet: Criss-Cross Attention for Semantic SegmentationZilong Huang, Xinggang Wang, Lichao Huang, Chang Huang et al.ICCV 2019 · 2,972 citations
Related papers
- Unleashing Multispectral Video's Potential in Semantic Segmentation: A Semi-supervised Viewpoint and New UAV-View BenchmarkWei Ji, Jingjing Li, Wenbo Li, Yilin Shen et al.NeurIPS 2024 · 8 citations
- Large-scale Video Panoptic Segmentation in the Wild: A BenchmarkJiaxu Miao, Xiaohan Wang, Yu Wu, Wei Li et al.CVPR 2022 · 58 citations
- SemanticRT: A Large-Scale Dataset and Method for Robust Semantic Segmentation in Multispectral ImagesWei Ji, Jingjing Li, Cheng Bian, Zhicheng Zhang et al.ACM MM 2023 · 22 citations
- Attentive Alignment Network for Multispectral Pedestrian DetectionNuo Chen, Jin Xie, Jing Nie, Jiale Cao et al.ACM MM 2023 · 26 citations
- Deep Depth Estimation from Thermal ImageUkcheol Shin, Jinsun Park, In So KweonCVPR 2023
