Physiology as Language: Translating Respiration to EEG during Sleep
Kaiwen Zha, Chao Li, Hao He, Peng Cao, Tianhong Li, Ali Mirzazadeh, Ellen Zhang, Jong Lee, Yoon Kim, Dina Katabi
Abstract
This paper introduces a novel cross-physiology translation task: synthesizing sleep electroencephalography (EEG) from respiration signals. To address the significant complexity gap between the two modalities, we propose a waveform-conditional generative framework that preserves fine-grained respiratory dynamics while constraining the EEG target space through discrete tokenization. Trained on over 28,000 individuals, our model achieves a 7% Mean Absolute Error in EEG spectrogram reconstruction. Beyond reconstruction, the synthesized EEG supports downstream tasks with performance comparable to ground truth EEG on age estimation (MAE 5.0 vs. 5.1 years), sex detection (AUROC 0.81 vs. 0.82), and sleep staging (Accuracy 0.84 vs. 0.88), significantly outperforming baselines trained directly on breathing. Finally, we demonstrate that the framework generalizes to contactless sensing by synthesizing EEG from wireless radio-frequency reflections, highlighting the feasibility of remote, non-contact neurological assessment during sleep.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bd2b20fe-24a2-432b-b4db-24df98ccc965Builds on2
Related papers
- SleepVST: Sleep Staging from Near-Infrared Video Signals using Pre-Trained TransformersJonathan F. Carter, João Jorge, Oliver Gibson, Lionel TarassenkoCVPR 2024
- SleepMG: Multimodal Generalizable Sleep Staging with Inter-modal Balance of Classification and Domain DiscriminationShuo Ma, Yingwei Zhang, Qiqi Zhang, Yiqiang Chen et al.ACM MM 2024 · 1 citation
- Cross-Subject EEG-to-Video Reconstruction and BeyondRunduo Han, Hongchen TanCVPR 2026
- Towards Voice Reconstruction from EEG during Imagined SpeechYoung-Eun Lee, Seo-Hyun Lee, Sang-Ho Kim, Seong-Whan LeeAAAI 2023 · 63 citations
- PATCHCODE: Discrete Latent Predictive Learning for EEG Foundation ModelKIEREN YU, Ziyang Liu, Chang Huang, Kaishun WUICML 2026
