When Tabular Foundation Models Meet Strategic Tabular Data: A Prior Alignment Approach
Xinpeng Lv, Yunxin Mao, Renzhe Xu, Chunyuan Zheng, Yikai Chen, Haoxuan Li, Jinxuan Yang, Yuanlong Chen, Kun Kuang, Mingyang Geng, Shixuan Liu, Wanrong Huang
摘要
Tabular foundation models based on pretrained prior-data fitted networks (PFNs) have shown strong generalization on diverse tabular tasks, but they are typically designed for non-strategic settings where data distributions are independent of deployed classifiers. In many real-world decision scenarios, however, individuals may strategically modify their features after deployment to obtain favorable outcomes, inducing a post-deployment distribution shift. This paper studies whether PFN-style tabular foundation models can generalize to such strategic tabular data. We show that strategic manipulation creates a fundamental mismatch between the non-strategic prior learned during pretraining and the post-manipulation strategic prior encountered at deployment, which leads to an irreducible structural prediction bias. To address this issue, we propose the Strategic Prior-data Fitted Network (SPN), an inference-time strategy-aware framework that adapts tabular foundation models to strategic environments without retraining or architectural modification. SPN constructs strategic in-context examples to approximate post-manipulation inputs and aligns PFN predictions with the induced strategic distribution via in-context learning, with theoretical guarantees on bias reduction. Experiments on real-world and synthetic tabular datasets show that SPN consistently improves robustness and predictive performance under strategic manipulation compared with both tabular foundation models and classical tabular methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- Beyond Rational Illusion: Behaviorally Realistic Strategic ClassificationXinpeng Lv, Yunxin Mao, Renzhe Xu, Chunyuan Zheng 等ICML 2026 · 被引用 1 次
- Beyond Independent Manipulation: Individual Fairness-aware Strategic Classification with Peer ImitationXinpeng Lv, Yunxin Mao, Renzhe Xu, Jinxuan Yang 等KDD 2026
它引用的顶会 Paper38
- MLP-Mixer: An all-MLP Architecture for VisionIlya O. Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer 等NeurIPS 2021 · 被引用 3,862 次
- TabNet: Attentive Interpretable Tabular LearningSercan Ö. Arik, Tomas PfisterAAAI 2021 · 被引用 2,148 次
- Revisiting Deep Learning Models for Tabular DataYury Gorishniy, Ivan Rubachev, Valentin Khrulkov, Artem BabenkoNeurIPS 2021 · 被引用 1,847 次
- Transformers Learn In-Context by Gradient DescentJohannes von Oswald, Eyvind Niklasson, Ettore Randazzo, João Sacramento 等ICML 2023 · 被引用 729 次
- Neural Oblivious Decision Ensembles for Deep Learning on Tabular DataSergei Popov, Stanislav Morozov, Artem BabenkoICLR 2020 · 被引用 407 次
相关 Paper
- Mitigating Label Shift in Tabular In-Context Learning via Test-Time Posterior AdjustmentSeunghan LeeICML 2026
- StablePFN: Stable Prediction with Causal-Aware Tabular Foundation ModelZhengkang Guan, Yikang Chen, Haoyuan Qian, Kairong Han 等KDD 2026
- Causal Strategic Classification: A Tale of Two ShiftsGuy Horowitz, Nir RosenfeldICML 2023 · 被引用 23 次
- Foundation Models for Causal Inference via Prior-Data Fitted NetworksYuchen Ma, Dennis Frauen, Emil Javurek, Stefan FeuerriegelICLR 2026 · 被引用 37 次
- Strategic Classification with Unknown User ManipulationsTosca Lechner, Ruth Urner, Shai Ben-DavidICML 2023 · 被引用 21 次
