Cross-Modality High-Frequency Transformer for MR Image Super-Resolution
Chaowei Fang, Dingwen Zhang, Liang Wang, Yulun Zhang, Lechao Cheng, Junwei Han
Abstract
Improving the resolution of magnetic resonance (MR) image data is critical to computer-aided diagnosis and brain function analysis. Higher resolution helps to capture more detailed content, but typically induces to lower signal-to-noise ratio and longer scanning time. To this end, MR image super-resolution has become a widely-interested topic in recent times. Existing works establish extensive deep models with the conventional architectures based on convolutional neural networks (CNN). In this work, to further advance this research field, we make an early effort to build a Transformer-based MR image super-resolution framework, with careful designs on exploring valuable domain prior knowledge. Specifically, we consider two-fold domain priors including the high-frequency structure prior and the inter-modality context prior, and establish a novel Transformer architecture, called Cross-modality high-frequency Transformer (Cohf-T), to introduce such priors into super-resolving the low-resolution (LR) MR images. Experiments on two datasets indicate that Cohf-T achieves new state-of-the-art performance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers7
- Decomposition-Based Variational Network for Multi-Contrast MRI Super-Resolution and ReconstructionPengcheng Lei, Faming Fang, Guixu Zhang, Tieyong ZengICCV 2023 · 39 citations
- Unsupervised Video Hashing with Multi-granularity Contextualization and Multi-structure PreservationYanbin Hao, Jingru Duan, Hao Zhang, Bin Zhu et al.ACM MM 2022 · 16 citations
- Parameterization of Cross-token Relations with Relative Positional Encoding for Vision MLPZhicai Wang, Yanbin Hao, Xingyu Gao, Hao Zhang et al.ACM MM 2022 · 8 citations
- Hierarchical Hourglass Convolutional Network for Efficient Video ClassificationYi Tan, Yanbin Hao, Hao Zhang, Shuo Wang et al.ACM MM 2022 · 8 citations
- Null Space Matters: Range-Null Decomposition for Consistent Multi-Contrast MRI ReconstructionJiacheng Chen, Jiawei Jiang, Fei Wu, Jianwei ZhengAAAI 2024 · 5 citations
Builds on11
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Segmenter: Transformer for Semantic SegmentationRobin Strudel, Ricardo Garcia, Ivan Laptev, Cordelia SchmidICCV 2021 · 1,898 citations
- Conformer: Local Features Coupling Global Representations for Visual RecognitionZhiliang Peng, Wei Huang, Shanzhi Gu, Lingxi Xie et al.ICCV 2021 · 723 citations
- Incremental Cross-view Mutual Distillation for Self-supervised Medical CT SynthesisChaowei Fang, Liang Wang, Dingwen Zhang, Jun Xu et al.CVPR 2022 · 26 citations
Related papers
- Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolutionGuangyuan Li, Jun Lv, Yapeng Tian, Qi Dou et al.CVPR 2022 · 100 citations
- MFTN: Multi-Level Feature Transfer Network Based on MRI-Transformer for MR Image Super-resolutionShuying Huang, Ge Chen, Yong Yang, Xiaozheng Wang et al.AAAI 2024 · 8 citations
- Feature Modulation Transformer: Cross-Refinement of Global Representation via High-Frequency Prior for Image Super-ResolutionAo Li, Le Zhang, Yun Liu, Ce ZhuICCV 2023 · 84 citations
- DuDoINet: Dual-Domain Implicit Network for Multi-Modality MR Image Arbitrary-scale Super-ResolutionGuangyuan Li, Wei Xing, Lei Zhao, Zehua Lan et al.ACM MM 2023 · 11 citations
- Rethinking Diffusion Model for Multi-Contrast MRI Super-ResolutionGuangyuan Li, Chen Rao, Juncheng Mo, Zhanjie Zhang et al.CVPR 2024
