Lune

ICCV2023Top-tier venue

Atmospheric Transmission and Thermal Inertia Induced Blind Road Segmentation with a Large-Scale Dataset TBRSD

Junzhang Chen, Xiangzhi Bai

Abstract

Computer vision-based walking assistants are prominent tools for aiding visually impaired people in navigation. Blind road segmentation is a key element in these walking assistant systems. However, most walking assistant systems rely on visual light images, which is dangerous in weak illumination environments such as darkness or fog. To address this issue and enhance the safety of vision-based walking assistant systems, we developed a thermal infrared blind road segmentation neural network (TINN). In contrast to conventional segmentation techniques that primarily concentrate on enhancing feature extraction and perception, our approach is geared towards preserving the inherent radiation characteristics within the thermal imaging process. Initially, we modelled two critical factors in thermal infrared imaging - thermal light atmospheric transmission and thermal inertia effect. Subsequently, we use an encoder-decoder architecture to fuse the feathers extracted by the two modules. Additionally, to train the network and evaluate the effectiveness of the proposed method, we constructed a large-scale thermal infrared blind road segmentation dataset named TBRSD consists 5180 pixel-level manual annotations. The experimental results demonstrate that our method outperforms existing techniques and achieves state-of-the-art performance in thermal blind road segmentation, as validated on benchmark thermal infrared semantic segmentation datasets such as MFNet and SODA. The dataset and our code are both publicly available in https://github.com/chenjzBUAA/TBRSD or http://xzbai.buaa.edu.cn/datasets.html.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Masked-attention Mask Transformer for Universal Image Segmentation cites Rethinking Semantic Segmentation From a Sequence-to-Sequence Perspective With Transformers
  • Masked-attention Mask Transformer for Universal Image Segmentation cites SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers
  • Vision Transformer Adapter for Dense Predictions cites Masked-attention Mask Transformer for Universal Image Segmentation
  • Vision Transformer Adapter for Dense Predictions cites Rethinking Semantic Segmentation From a Sequence-to-Sequence Perspective With Transformers
  • Vision Transformer Adapter for Dense Predictions cites Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentation
  • Vision Transformer Adapter for Dense Predictions cites SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers
  • Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentation cites Masked-attention Mask Transformer for Universal Image Segmentation
  • UNIP: Rethinking Pre-trained Attention Patterns for Infrared Semantic Segmentation cites Masked-attention Mask Transformer for Universal Image Segmentation
  • UNIP: Rethinking Pre-trained Attention Patterns for Infrared Semantic Segmentation cites Vision Transformer Adapter for Dense Predictions
  • UNIP: Rethinking Pre-trained Attention Patterns for Infrared Semantic Segmentation cites Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentation
  • UNIP: Rethinking Pre-trained Attention Patterns for Infrared Semantic Segmentation cites SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers
  • SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers cites Rethinking Semantic Segmentation From a Sequence-to-Sequence Perspective With Transformers
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. Projecting Trackable Thermal Patterns for Dynamic Computer VisionMark Sheinin, Aswin C. Sankaranarayanan, Srinivasa G. NarasimhanCVPR 2024 · 3 citations
  2. UNIP: Rethinking Pre-trained Attention Patterns for Infrared Semantic SegmentationTao Zhang, Jinyong Wen, Zhen Chen, Kun Ding et al.ICLR 2025

Builds on5

  1. SegFormer: Simple and Efficient Design for Semantic Segmentation with TransformersEnze Xie, Wenhai Wang, Zhiding Yu, Anima Anandkumar et al.NeurIPS 2021 · 9,661 citations
  2. Vision Transformer Adapter for Dense PredictionsZhe Chen, Yuchen Duan, Wenhai Wang, Junjun He et al.ICLR 2023 · 204 citations
  3. Masked-attention Mask Transformer for Universal Image SegmentationBowen Cheng, Ishan Misra, Alexander G. Schwing, Alexander Kirillov et al.CVPR 2022
  4. Rethinking Semantic Segmentation From a Sequence-to-Sequence Perspective With TransformersSixiao Zheng, Jiachen Lu, Hengshuang Zhao, Xiatian Zhu et al.CVPR 2021
  5. Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and SegmentationFeng Li, Hao Zhang, Huaizhe Xu, Shilong Liu et al.CVPR 2023

Related papers

  1. Deep Depth Estimation from Thermal ImageUkcheol Shin, Jinsun Park, In So KweonCVPR 2023
  2. Dual-Teacher Interactive Knowledge Distillation Network for Text-to-Visible & Infrared Person RetrievalChenglong Li, Zhengyu Chen, Yifei Deng, Aihua ZhengAAAI 2026
  3. SemanticRT: A Large-Scale Dataset and Method for Robust Semantic Segmentation in Multispectral ImagesWei Ji, Jingjing Li, Cheng Bian, Zhicheng Zhang et al.ACM MM 2023 · 22 citations
  4. Multi-Task Driven Feature Models for Thermal Infrared TrackingQiao Liu, Xin Li, Zhenyu He, Nana Fan et al.AAAI 2020 · 73 citations
  5. ABMDRNet: Adaptive-Weighted Bi-Directional Modality Difference Reduction Network for RGB-T Semantic SegmentationQiang Zhang, Shenlu Zhao, Yongjiang Luo, Dingwen Zhang et al.CVPR 2021
Dusk over the sea between two cliffs drawn in fine vertical lines