Principle-Evolvable Scientific Discovery via Uncertainty Minimization
Yingming Pu, Tao LIN, Hongyu Chen
Abstract
Large Language Model (LLM)-based scientific agents have accelerated scientific discovery, yet they often suffer from significant inefficiencies due to adherence to fixed initial priors. Existing approaches predominantly operate within a static hypothesis space, which restricts the discovery of novel phenomena, resulting in computational waste when baseline theories fail. To address this, we propose shifting the focus from searching hypotheses to evolving the underlying scientific principles. We present , a principle-evolvable framework that treats scientific discovery as Bayesian optimization over an expanding principle space. By integrating Information-Directed Hypothesis Selection via Gaussian Process and an anomaly-driven augmentation mechanism, PiEvo enables agents to autonomously refine their theoretical worldview. Evaluation across four benchmarks demonstrates that PiEvo (1) achieves an average solution quality of up to 90.81%93.15%, representing a 29.7%31.1% improvement over the state-of-the-art, (2) attains an 83.3% speedup in convergence step via significantly reduced sample complexity by optimizing the compact principle space, and (3) maintains robust performance across diverse scientific domains and LLM backbones. Code is publicly available at github.com/amair-lab/PiEvo.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a300ef71-3dba-4697-b595-c087b751078cBuilds on7
- Hypothesis Search: Inductive Reasoning with Language ModelsRuocheng Wang, Eric Zelikman, Gabriel Poesia, Yewen Pu et al.ICLR 2024 · 156 citations
- AI-Researcher: Autonomous Scientific InnovationJiabin Tang, Lianghao Xia, Zhonghang Li, Chao HuangNeurIPS 2025 · 101 citations
- Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent SystemHaoyang Su, Renqi Chen, Shixiang Tang, Zhenfei Yin et al.ACL 2025 · 49 citations
- From Selection to Generation: A Survey of LLM-based Active LearningYu Xia, Subhojyoti Mukherjee, Zhouhang Xie, Junda Wu et al.ACL 2025 · 18 citations
- From Words to Actions: Unveiling the Theoretical Underpinnings of LLM-Driven Autonomous SystemsJianliang He, Siyu Chen, Fengzhuo Zhang, Zhuoran YangICML 2024 · 12 citations
Related papers
- Evo-PI: Aligning Medical Reasoning via Evolving Principle-Guided SupervisionXianda Zheng, Huan Gao, Meng-Fen Chiang, Michael J. Witbrock et al.ACL 2026
- EvoSci: A Bio-Inspired Multi-Agent Framework for the Evolution of Scientific DiscoveryXiaoyu Xiong, Yuqi Ren, Deyi XiongACL 2026 · 1 citation
- DecAEvolve: Decompose, Adapt, and Evolve for Effective LLM-based Scientific Equation DiscoveryPouya Behzadifar, Parshin Shojaee, Sanchit Kabra, Kazem Meidani et al.ICML 2026
- LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific DiscoveryPingchuan Ma, Tsun-Hsuan Wang, Minghao Guo, Zhiqing Sun et al.ICML 2024 · 76 citations
- Automated Hypothesis Validation with Agentic Sequential FalsificationsKexin Huang, Ying Jin, Ryan Li, Michael Y. Li et al.ICML 2025
