Set-Preserving Calibration from Conformal P-Values to E-Values
Nabil Alami, Jad Zakharia, Souhaib Ben Taieb
Abstract
Standard conformal prediction (CP) procedures are typically formulated in terms of p-values, but reliance on p-values alone limits flexibility, for example, when combining dependent evidence across models or data splits. Recent work has explored e-value formulations for conformal inference, yet a direct connection between p-and e-value formulations in CP has been missing, especially regarding their statistical efficiency. We first identify limitations of classical p-to-e calibrators in the CP setting, showing that they are not set-preserving and can lead to overly conservative prediction sets. To address this, we propose a novel P2E calibrator that converts conformal p-values into e-values without altering the prediction set induced by the original conformal p-value. We establish both theoretically and empirically that our calibrator can yield significant efficiency gains over existing p-to-e calibrators. This e-value formulation enables principled use of recent advances in e-value merging and randomization, where we demonstrate its impact in two applications: cross-conformal prediction (CCP), whose variants typically provide only approximate 1 -2α coverage, and conformal aggregation (CA). In both cases, our e-value-based methods satisfy the desired 1 -α coverage guarantee while improving efficiency over standard baselines. More broadly, our approach expands the flexibility of CP and opens new directions for efficient, distribution-free uncertainty quantification. Modern machine learning models are increasingly deployed in high-stakes domains where uncertainty is as critical as accuracy. Conformal prediction (CP) has emerged as a versatile framework for constructing prediction sets in both
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7d822e30-f168-47c6-8a44-3f5d2f7bf4c0Builds on5
- Backward Conformal PredictionEtienne Gauthier, Francis Bach, Michael I. JordanNeurIPS 2025 · 19 citations
- Conformal Prediction for Ensembles: Improving Efficiency via Score-Based AggregationYash Patel, Eduardo Ochoa Rivera, Ambuj TewariNeurIPS 2025 · 9 citations
- Symmetric Aggregation of Conformity Scores for Efficient Uncertainty SetsNabil Alami, Jad Zakharia, Souhaib Ben TaiebAAAI 2026 · 2 citations
- Improving the Statistical Efficiency of Cross-Conformal PredictionMatteo Gasparin, Aaditya RamdasICML 2025
- Conformity Score Averaging for ClassificationRui Luo, Zhixin ZhouICML 2025
Related papers
- Derandomized novelty detection with FDR control via conformal e-valuesMeshi Bashari, Amir Epstein, Yaniv Romano, Matteo SesiaNeurIPS 2023 · 28 citations
- Minimum-Length Conformal Prediction Sets for Ordinal ClassificationZijian Zhang, Xinyu Chen, Yuanjie Shi, Liyuan Lillian Ma et al.AAAI 2026
- Non-exchangeable Conformal Prediction with Optimal Transport: Tackling Distribution Shift with Unlabeled DataAlvaro H. C. Correia, Christos LouizosNeurIPS 2025 · 5 citations
- Conformalized Interval Arithmetic with Symmetric CalibrationRui Luo, Zhixin ZhouAAAI 2025 · 11 citations
- Multi-model Ensemble Conformal Prediction in Dynamic EnvironmentsErfan Hajihashemi, Yanning ShenNeurIPS 2024 · 13 citations
