Lune

EMNLP Findings2025

PAMN: Multi-phase Correlation Modeling for Contrast-Enhanced 3D Medical Image Retrieval

Haonan Tong, Ke Liu, Chuang Zhang, Xinglin Zhang, Tao Chen, Jenq-Neng Hwang, Lei Li

Abstract

Contrast-enhanced 3D Medical imaging (e.g., CT, MRI) leverages phase sequences to uncover temporal dynamics vital for diagnosing tumors, lesions, and vascular issues. However, current retrieval models primarily focus on spatial features, neglecting phase-specific progression detailed in clinical reports. We present the Phaseaware Memory Network (PAMN), a novel framework enhancing 3D medical image retrieval by fusing imaging phases with diagnostic text. PAMN creates rich radiological representations that enhance diagnostic accuracy by combining image details with clinical report context, rigorously tested on a novel phaseseries dataset of 12,230 hospital CT scans. PAMN achieves an effective balance of performance and scalability in 3D radiology retrieval, outperforming state-of-the-art baselines through the robust fusion of spatial, temporal, and textual information.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. SymDiag: Explainable Diagnosis for LLM Reasoning via Neuro-Symbolic VerificationWenyao Cui, Huaping Zhang, Yongyi Huang, Qiuchi Li et al.KDD 2026

Builds on15

  1. Contrastive Multi-View Representation Learning on GraphsKaveh Hassani, Amir Hosein Khas AhmadiICML 2020 · 1,663 citations
  2. EfficientViT: Lightweight Multi-Scale Attention for High-Resolution Dense PredictionHan Cai, Junyan Li, Muyan Hu, Chuang Gan et al.ICCV 2023 · 265 citations
  3. Towards Discriminative Representation: Multi-view Trajectory Contrastive Learning for Online Multi-object TrackingEn Yu, Zhuoling Li, Shoudong HanCVPR 2022 · 54 citations
  4. DVANet: Disentangling View and Action Features for Multi-View Action RecognitionNyle Siddiqui, Praveen Tirupattur, Mubarak ShahAAAI 2024 · 39 citations
  5. Vision-LSTM: xLSTM as Generic Vision BackboneBenedikt Alkin, Maximilian Beck, Korbinian Pöppel, Sepp Hochreiter et al.ICLR 2025 · 20 citations

Related papers

  1. Cross-modal Memory Networks for Radiology Report GenerationZhihong Chen, Yaling Shen, Yan Song, Xiang WanACL 2021
  2. CPR-RAG: Clinical Prior-Regularized Retrieval for Anatomy-Aware 3D CT Report GenerationSungkyu Yang, Kang-Min Kim, Mansu KimACL 2026
  3. MMTN: Multi-Modal Memory Transformer Network for Image-Report Consistent Medical Report GenerationYiming Cao, Lizhen Cui, Lei Zhang, Fuqiang Yu et al.AAAI 2023 · 56 citations
  4. GLoRIA: A Multimodal Global-Local Representation Learning Framework for Label-efficient Medical Image RecognitionShih-Cheng Huang, Liyue Shen, Matthew P. Lungren, Serena YeungICCV 2021 · 516 citations
  5. Mitigating Entity Hallucinations in 3D Radiology Report Generation via Dual-Stream AlignmentLingyu Zhou, Yue Yu, Zhang Yi, Xiuyuan XuAAAI 2026
Dusk over the sea between two cliffs drawn in fine vertical lines