Incremental Cross-view Mutual Distillation for Self-supervised Medical CT Synthesis
Chaowei Fang, Liang Wang, Dingwen Zhang, Jun Xu, Yixuan Yuan, Junwei Han
Abstract
Due to the constraints of the imaging device and high cost in operation time, computer tomography (CT) scans are usually acquired with low within-slice resolution. Improving the inter-slice resolution is beneficial to the disease diagnosis for both human experts and computer-aided systems. To this end, this paper builds a novel medical slice synthesis to increase the inter-slice resolution. Considering that the groundtruth intermediate medical slices are always absent in clinical practice, we introduce the incremental cross-view mutual distillation strategy to accomplish this task in the self-supervised learning manner. Specifically, we model this problem from three different views: slice-wise interpolation from axial view and pixel-wise interpolation from coronal and sagittal views. Under this circumstance, the models learned from different views can distill valuable knowledge to guide the learning processes of each other. We can repeat this process to make the models synthesize intermediate slice data with increasing between-slice resolution. To demonstrate the effectiveness of the proposed approach, we conduct comprehensive experiments on a large-scale <tex xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"></tex> dataset. Quantitative and qualitative comparison results show that our method outperforms state-of-the-art algorithms by clear margins.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f1441816-320d-4e46-8ed2-19025277b11bCited by top-tier papers2
- Cross-Modality High-Frequency Transformer for MR Image Super-ResolutionChaowei Fang, Dingwen Zhang, Liang Wang, Yulun Zhang et al.ACM MM 2022 · 57 citations
- CycleINR: Cycle Implicit Neural Representation for Arbitrary-Scale Volumetric Super-Resolution of Medical DataWei Fang, Yuxing Tang, Heng Guo, Mingze Yuan et al.CVPR 2024
Builds on11
- Improved Knowledge Distillation via Teacher AssistantSeyed-Iman Mirzadeh, Mehrdad Farajtabar, Ang Li, Nir Levine et al.AAAI 2020 · 1,361 citations
- Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image AnalysisYucheng Tang, Dong Yang, Wenqi Li, Holger R. Roth et al.CVPR 2022 · 736 citations
- Channel Attention Is All You Need for Video Frame InterpolationMyungsub Choi, Heewon Kim, Bohyung Han, Ning Xu et al.AAAI 2020 · 362 citations
- Asymmetric Bilateral Motion Estimation for Video Frame InterpolationJunheum Park, Chul Lee, Chang-Su KimICCV 2021 · 186 citations
- Learning Frequency-aware Dynamic Network for Efficient Super-ResolutionWenbin Xie, Dehua Song, Chang Xu, Chunjing Xu et al.ICCV 2021 · 89 citations
Related papers
- Towards Cross-Modality Medical Image Segmentation with Online Mutual Knowledge DistillationKang Li, Lequan Yu, Shujun Wang, Pheng-Ann HengAAAI 2020 · 115 citations
- Multi-modal Vision Pre-training for Medical Image AnalysisShaohao Rui, Lingzhi Chen, Zhenyu Tang, Lilong Wang et al.CVPR 2025
- Bootstrapping Chest CT Image Understanding by Distilling Knowledge from X-Ray Expert ModelsWeiwei Cao, Jianpeng Zhang, Yingda Xia, Tony C. W. Mok et al.CVPR 2024
- Incremental Nuclei Segmentation from Histopathological Images via Future-class Awareness and Compatibility-inspired DistillationHuyong Wang, Huisi Wu, Jing QinCVPR 2024 · 9 citations
- Continual Self-Supervised Learning: Towards Universal Multi-Modal Medical Data Representation LearningYiwen Ye, Yutong Xie, Jianpeng Zhang, Ziyang Chen et al.CVPR 2024 · 30 citations
