Lune

EMNLP Findings2022

Unsupervised Text Deidentification

John X. Morris, Justin T. Chiu, Ramin Zabih, Alexander M. Rush

Abstract

Deidentification seeks to anonymize textual data prior to distribution. Automatic deidentification primarily uses supervised named entity recognition from human-labeled data points. We propose an unsupervised deidentification method that masks words that leak personallyidentifying information. The approach utilizes a specially trained reidentification model to identify individuals from redacted personal documents. Motivated by K-anonymity based privacy, we generate redactions that ensure a minimum reidentification rank for the correct profile of the document. To evaluate this approach, we consider the task of deidentifying Wikipedia Biographies, and evaluate using an adversarial reidentification metric. Compared to a set of unsupervised baselines, our approach deidentifies documents more completely while removing fewer words. Qualitatively, we see that the approach eliminates many identifying aspects that would fall outside of the common named entity based approach. 1

Ask Lune

Ask anything. The answer quotes the paper.

Lune reads all of it and the papers around it, then shows you the passages behind every answer.

Questions to start from

Lune answers from

the full paper · 10 top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Cited by top-tier papers10

  1. Large-scale online deanonymization with LLMsSimon Lermen, Daniel Paleka, Joshua Swanson, Michael Aerni et al.USENIX Security 2026 · 20 citations
  2. Reducing Privacy Risks in Online Self-Disclosures with Language ModelsYao Dou, Isadora Krsek, Tarek Naous, Anubha Kabra et al.ACL 2024 · 14 citations
  3. Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023?Shuheng Liu, Alan RitterACL 2023 · 9 citations
  4. Measuring, Modeling, and Helping People Account for Privacy Risks in Online Self-Disclosures with AIIsadora Krsek, Anubha Kabra, Yao Dou, Tarek Naous et al.CSCW 2025 · 6 citations
  5. Probabilistic Reasoning with LLMs for Privacy Risk EstimationJonathan Zheng, Alan Ritter, Sauvik Das, Wei (Coco) XuNeurIPS 2025 · 3 citations

Builds on7

  1. Large Language Models Can Be Strong Differentially Private LearnersXuechen Li, Florian Tramèr, Percy Liang, Tatsunori HashimotoICLR 2022 · 502 citations
  2. Dense Passage Retrieval for Open-Domain Question AnsweringVladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick Lewis et al.EMNLP 2020 · 142 citations
  3. Learning Variational Word Masks to Improve the Interpretability of Neural Text ClassifiersHanjie Chen, Yangfeng JiEMNLP 2020 · 45 citations
  4. Probabilistically Masked Language Model Capable of Autoregressive Generation in Arbitrary Word OrderYi Liao, Xin Jiang, Qun LiuACL 2020 · 28 citations
  5. TaPas: Weakly Supervised Table Parsing via Pre-trainingJonathan Herzig, Pawel Krzysztof Nowak, Thomas Müller, Francesco Piccinno et al.ACL 2020 · 19 citations

Related papers

  1. Re-identification of De-identified Documents with Autoregressive InfillingLucas Georges Gabriel Charpentier, Pierre LisonACL 2025
  2. De-Identification of Sensitive Personal Data in Datasets Derived from IIT-CDIPStefan Larson, Nicole Lima, Santiago Diaz, Amogh Manoj Joshi et al.EMNLP 2024 · 1 citation
  3. Automatic Named Entity Obfuscation in SpeechJudita PreissACL Findings 2023 · 3 citations
  4. Not What the Doctor Ordered: Surveying LLM-based De-identification and Quantifying Clinical Information LossKiana Aghakasiri, Noopur Zambare, JoAnn Thai, Carrie Ye et al.EMNLP 2025 · 1 citation
  5. Person De-reidentification: A Variation-guided Identity Shift ModelingYi-Xing Peng, Yu-Ming Tang, Kun-Yu Lin, Qize Yang et al.CVPR 2025
Dusk over the sea between two cliffs drawn in fine vertical lines