Lune

ICML2026Top-tier venue

Privasis: Synthesizing the Largest "Public" Private Dataset from Scratch

Hyunwoo Kim, Niloofar Mireshghallah, Michael Duan, Rui Xin, Stella Li, Jaehun Jung, David Acuna, Qi Pang, Hanshen Xiao, Edward Suh, Sewoong Oh, Yulia Tsvetkov

2026Year
3Citations

Abstract

Research involving privacy-sensitive data has always been constrained by data scarcity, standing in sharp contrast to other areas that have benefited from data scaling. This challenge is becoming increasingly urgent as modern AI agents-such as OpenClaw and Gemini Agent-are granted persistent access to highly sensitive personal information. To tackle this longstanding bottleneck and the rising risks, we present PRIVASIS (i.e., privacy oasis), the first million-scale fully synthetic dataset entirely built from scratch-an expansive reservoir of texts with rich and diverse private information-designed to broaden and accelerate research in areas where processing sensitive social data is inevitable. Compared to existing datasets, PRIVASIS, comprising 1.4 million records, offers orders-of-magnitude larger scale with quality, and far greater diversity across various document types, including medical history, legal documents, financial records, calendars, and text messages with a total of 55.1 million annotated attributes such as ethnicity, date of birth, workplace, etc. We leverage PRIVASIS to construct a parallel corpus for text sanitization with our pipeline that decomposes texts and applies targeted sanitization. Our compact sanitization models (≤4B) trained on this dataset outperform state-of-the-art large language models, such as GPT-5 and Qwen-3 235B. We plan to release data, models, and code to accelerate future research on privacy-sensitive domains and agents. 1

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

lune papers fulltext 55eb1927-9db5-4b4f-acf0-587601814f32

Builds on18

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines