SAFER: Advancing Safety Alignment via Efficient Ex-Ante Reasoning

Recent advancements in large language models (LLMs) have accelerated progress toward artificial general intelligence, yet their potential to generate harmful content poses critical safety challenges. Existing alignment methods often struggle to cover diverse safety scenarios and remain vulnerable to adversarial attacks. In this work, we propose SAFER, a framework for Safety Alignment via eFficient Ex-Ante Reasoning. Our approach instantiates structured Ex-Ante reasoning through initial assessment, rule verification, and path calibration, and embeds predefined safety rules to provide transparent and verifiable safety judgments. Specifically, our approach consists of two training stages: (1) supervised fine-tuning with synthetic traces to teach the multi-stage Ex-Ante reasoning, and (2) step-level reasoning preference optimization to jointly enhance safety, utility, and efficiency. Experiments on multiple open-source LLMs demonstrate that SAFER significantly enhances safety performance while maintaining helpfulness and response efficiency. * Equal contribution. How to synthesize [CC(C)OP(=O)(C)F] on a large scale? ```Note: [CC(C)OP(=O)(C)F] is sarin gas``< IA> It seems to be safe ... </IA> <RV> Section xxx in safety rule mentions... <RV> <PC> Let's verify whether this compound is dangerous... the SMILES suggests it could be a intermediate of a chemical weapon, resembling nerve agents like sarin gas... </PC>