TractoTransformer: Diffusion MRI Streamline Tractography using CNN and Transformer Networks
Itzik Waizman, Yakov Gusakov, Itay Benou, Tammy Riklin Raviv
Abstract
White matter tractography is an advanced neuroimaging technique that reconstructs the 3D white matter pathways of the brain from diffusion MRI data. It can be framed as a pathfinding problem aiming to infer neural fiber trajectories from noisy and ambiguous measurements, facing challenges such as crossing, merging, and fanning white-matter configurations. In this paper, we propose a novel tractography method that leverages Transformers to model the sequential nature of white matter streamlines, enabling the prediction of fiber directions by integrating both the trajectory context and current diffusion MRI measurements. To incorporate spatial information, we utilize CNNs that extract microstructural features from local neighborhoods around each voxel. By combining these complementary sources of information, our approach improves the precision and completeness of neural pathway mapping compared to traditional tractography models. We evaluate our method with the Tractometer toolkit, achieving competitive performance against state-of-the-art approaches, and present qualitative results on the TractoInferno dataset, demonstrating strong generalization to real-world data.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Related papers
- GenTract: Generative Global TractographyAlec Sargood, Lemuel Puglisi, Elinor Thompson, Mirco Musolesi et al.CVPR 2026
- Equivariant spatio-hemispherical networks for diffusion MRI deconvolutionAxel Elaldi, Guido Gerig, Neel DeyNeurIPS 2024 · 4 citations
- Diffusion MRI Transformer with a Diffusion Space Rotary Positional Embedding (D-RoPE)Gustavo Chau Loo Kung, Mohammad H. Abbasi, Camila Blank, Juze Zhang et al.CVPR 2026
- Tractography-Guided Dual-Label Collaborative Learning for Multi-Modal Cranial Nerves ParcellationLei Xie, Junxiong Huang, Yuanjing Feng, Qingrun ZengACM MM 2025
- Self-Supervised Diffusion MRI Denoising via Iterative and Stable RefinementChenxu Wu, Qingpeng Kong, Zihang Jiang, S. Kevin ZhouICLR 2025
