Atmospheric Transmission and Thermal Inertia Induced Blind Road Segmentation with a Large-Scale Dataset TBRSD
Junzhang Chen, Xiangzhi Bai
Abstract
Computer vision-based walking assistants are prominent tools for aiding visually impaired people in navigation. Blind road segmentation is a key element in these walking assistant systems. However, most walking assistant systems rely on visual light images, which is dangerous in weak illumination environments such as darkness or fog. To address this issue and enhance the safety of vision-based walking assistant systems, we developed a thermal infrared blind road segmentation neural network (TINN). In contrast to conventional segmentation techniques that primarily concentrate on enhancing feature extraction and perception, our approach is geared towards preserving the inherent radiation characteristics within the thermal imaging process. Initially, we modelled two critical factors in thermal infrared imaging - thermal light atmospheric transmission and thermal inertia effect. Subsequently, we use an encoder-decoder architecture to fuse the feathers extracted by the two modules. Additionally, to train the network and evaluate the effectiveness of the proposed method, we constructed a large-scale thermal infrared blind road segmentation dataset named TBRSD consists 5180 pixel-level manual annotations. The experimental results demonstrate that our method outperforms existing techniques and achieves state-of-the-art performance in thermal blind road segmentation, as validated on benchmark thermal infrared semantic segmentation datasets such as MFNet and SODA. The dataset and our code are both publicly available in https://github.com/chenjzBUAA/TBRSD or http://xzbai.buaa.edu.cn/datasets.html.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
2 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Masked-attention Mask Transformer for Universal Image Segmentation cites Rethinking Semantic Segmentation From a Sequence-to-Sequence Perspective With Transformers
- Masked-attention Mask Transformer for Universal Image Segmentation cites SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers
- Vision Transformer Adapter for Dense Predictions cites Masked-attention Mask Transformer for Universal Image Segmentation
- Vision Transformer Adapter for Dense Predictions cites Rethinking Semantic Segmentation From a Sequence-to-Sequence Perspective With Transformers
- Vision Transformer Adapter for Dense Predictions cites Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentation
- Vision Transformer Adapter for Dense Predictions cites SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers
- Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentation cites Masked-attention Mask Transformer for Universal Image Segmentation
- UNIP: Rethinking Pre-trained Attention Patterns for Infrared Semantic Segmentation cites Masked-attention Mask Transformer for Universal Image Segmentation
- UNIP: Rethinking Pre-trained Attention Patterns for Infrared Semantic Segmentation cites Vision Transformer Adapter for Dense Predictions
- UNIP: Rethinking Pre-trained Attention Patterns for Infrared Semantic Segmentation cites Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentation
- UNIP: Rethinking Pre-trained Attention Patterns for Infrared Semantic Segmentation cites SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers
- SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers cites Rethinking Semantic Segmentation From a Sequence-to-Sequence Perspective With Transformers
Cited by top-tier papers2
Builds on5
- SegFormer: Simple and Efficient Design for Semantic Segmentation with TransformersEnze Xie, Wenhai Wang, Zhiding Yu, Anima Anandkumar et al.NeurIPS 2021 · 9,661 citations
- Vision Transformer Adapter for Dense PredictionsZhe Chen, Yuchen Duan, Wenhai Wang, Junjun He et al.ICLR 2023 · 204 citations
- Masked-attention Mask Transformer for Universal Image SegmentationBowen Cheng, Ishan Misra, Alexander G. Schwing, Alexander Kirillov et al.CVPR 2022
- Rethinking Semantic Segmentation From a Sequence-to-Sequence Perspective With TransformersSixiao Zheng, Jiachen Lu, Hengshuang Zhao, Xiatian Zhu et al.CVPR 2021
- Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and SegmentationFeng Li, Hao Zhang, Huaizhe Xu, Shilong Liu et al.CVPR 2023
Related papers
- Deep Depth Estimation from Thermal ImageUkcheol Shin, Jinsun Park, In So KweonCVPR 2023
- Dual-Teacher Interactive Knowledge Distillation Network for Text-to-Visible & Infrared Person RetrievalChenglong Li, Zhengyu Chen, Yifei Deng, Aihua ZhengAAAI 2026
- SemanticRT: A Large-Scale Dataset and Method for Robust Semantic Segmentation in Multispectral ImagesWei Ji, Jingjing Li, Cheng Bian, Zhicheng Zhang et al.ACM MM 2023 · 22 citations
- Multi-Task Driven Feature Models for Thermal Infrared TrackingQiao Liu, Xin Li, Zhenyu He, Nana Fan et al.AAAI 2020 · 73 citations
- ABMDRNet: Adaptive-Weighted Bi-Directional Modality Difference Reduction Network for RGB-T Semantic SegmentationQiang Zhang, Shenlu Zhao, Yongjiang Luo, Dingwen Zhang et al.CVPR 2021
