Every Step Counts: Decoding Trajectories as Authorship Fingerprints of dLLMs
Qi Li, Runpeng Yu, Haiquan Lu, Xinchao Wang
Abstract
Discrete Diffusion Large Language Models (dLLMs) have recently emerged as a competitive paradigm for non-autoregressive language modeling. Their distinctive decoding mechanism enables faster inference speed and strong performance in code generation and mathematical tasks. In this work, we show that the decoding mechanism of dLLMs not only enhances model utility but also can be used as a powerful tool for model attribution. Specifically, by analyzing the decoding trajectory associated with a given response, we can effectively identify its source model, thereby helping to mitigate risks of harmful content caused by model misuse. A key challenge in this problem lies in the diversity of attribution scenarios, including distinguishing between different models as well as between different checkpoints or backups of the same model. To ensure broad applicability, we identify two fundamental problems: what information to extract from the decoding trajectory, and how to utilize it effectively. We first observe that relying directly on per-step model confidence yields poor performance. This is mainly due to the bidirectional decoding nature of dLLMs: each newly decoded token influences the confidence of other decoded tokens, making model confidence highly redundant and washing out structural signal regarding decoding order or dependencies. To overcome this, we propose a novel information extraction scheme called the Directed Decoding Map (DDM), which captures structural relationships between decoding steps and better reveals model-specific behaviors. Furthermore, to make full use of the extracted structural information during attribution, we propose Gaussian-Trajectory Attribution (GTA), where we fit a cell-wise Gaussian distribution at each decoding position for each target model, and define the loglikelihood of a trajectory under different distributions as the attribution score: if a trajectory exhibits higher log-likelihood under the distribution of a specific model, it is more likely to have been generated by that model. Extensive experiments under different settings validate the utility of our methods. Code is available here.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fc21ef5e-48fc-458f-95ed-c0e6b926f8f7Cited by top-tier papers1
Ask how each one uses itBuilds on7
- DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability CurvatureEric Mitchell, Yoonho Lee, Alexander Khazatsky, Christopher D. Manning et al.ICML 2023 · 988 citations
- Large Language Diffusion ModelsShen Nie, Fengqi Zhu, Zebin You, Xiaolu Zhang et al.NeurIPS 2025 · 949 citations
- A Watermark for Large Language ModelsJohn Kirchenbauer, Jonas Geiping, Yuxin Wen, Jonathan Katz et al.ICML 2023 · 854 citations
- The Devil behind the mask: An emergent safety vulnerability of Diffusion LLMsZichen Wen, Jiashu Qu, Zhaorun Chen, Xiaoya Lu et al.ICLR 2026 · 32 citations
- Where to Start Alignment? Diffusion Large Language Model May Demand a Distinct PositionZhixin Xie, Xurui Song, Jun LuoAAAI 2026 · 7 citations
Related papers
- Trajectory-Level Speculative Decoding for Diffusion Language ModelsTianxiang Pan, Baitao Gong, Mo Guang, Hongwei Yong et al.ICML 2026
- Tracing the Roots: Leveraging Temporal Dynamics in Diffusion Trajectories for Origin AttributionAndreas Floros, Seyed-Mohsen Moosavi-Dezfooli, Pier Luigi DragottiNeurIPS 2025 · 1 citation
- Hierarchy Decoding: A Training-free Parallel Decoding Strategy for Diffusion Large Language ModelsXiaojing Qi, Lun Du, Xinyuan Zhang, Lanning Wei et al.ICLR 2026
- dgMARK: Decoding-Guided Watermarking for Diffusion Language ModelsPyo Min Hong, Albert NoICML 2026
- Matching Pairs: Attributing Fine-Tuned Models to their Pre-Trained Large Language ModelsMyles Foley, Ambrish Rawat, Taesung Lee, Yufang Hou et al.ACL 2023 · 2 citations
