EMBGuard: Constructing Hazard-Aware Guardrails for Safe Planning in Embodied Agents
Dongwook Choi, Taeyoon Kwon, Bogyung Jeong, Minju Kim, Yeonjun Hwang, Hyojun Kim, Byungchul Kim, Young Kyun Jang, Jinyoung Yeo
Abstract
MLLM-powered embodied agents deployed in real-world environments encounter physical hazards. However, existing approaches lack explicit mechanisms for identifying hazards and reasoning about action-conditioned risks, leading agents to either miss risky interactions or over-identify risks. To address this, we propose EMBGuard, the first MLLM-based safety guardrail for embodied agents designed to decouple physical risk reasoning from agent policy. By evaluating a (visual observation, action) pair, EMBGuard identifies hazardous configurations and provides natural language explanations of potential risks. Alongside EMBGuard, we contribute EMBHazard, a training dataset of 15.1K action-conditioned pairs, and EMBGuardTest, a benchmark of 329 manually curated real-world scenarios spanning seven physical risk categories. Through compositional variation of hazards and actions, we generate diverse risky and benign scenarios that agents may encounter during planning. Despite its compact size (2B, 4B), EMBGuard achieves performance competitive with proprietary MLLMs (e.g., GPT-5.1, Gemini-2.5-Pro) while significantly reducing the false-positive rates that hinder real-time deployment. We make the code, data, and models publicly available at https://github.com/dongwxxkchoi/EMBGuard.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bc010567-4fa8-4583-bfe2-18a88fa68f0fBuilds on5
- IS-Bench: Evaluating Interactive Safety of VLM-Driven Embodied Agents in Daily Household TasksXiaoya Lu, Zeren Chen, Xuhao Hu, Yijin Zhou et al.AAAI 2026 · 20 citations
- Embodied Agents Meet Personalization: Investigating Challenges and Solutions Through the Lens of Memory UtilizationTaeyoon Kwon, Dongwook Choi, Hyojun Kim, Sunghwan Kim et al.ICLR 2026 · 14 citations
- Subtle Risks, Critical Failures: A Framework for Diagnosing Physical Safety of LLMs for Embodied Decision MakingYejin Son, Minseo Kim, Sungwoong Kim, Seungju Han et al.EMNLP 2025 · 7 citations
- Safe Planner: Empowering Safety Awareness in Large Pre-Trained Models for Robot Task PlanningSiyuan Li, Feifan Liu, Lingfei Cui, Jiani Lu et al.AAAI 2025 · 4 citations
- SafeWatch: An Efficient Safety-Policy Following Video Guardrail Model with Transparent ExplanationsZhaorun Chen, Francesco Pinto, Minzhou Pan, Bo LiICLR 2025
Related papers
- HAZARD Challenge: Embodied Decision Making in Dynamically Changing EnvironmentsQinhong Zhou, Sunli Chen, Yisong Wang, Haozhe Xu et al.ICLR 2024 · 33 citations
- Multimodal Situational SafetyKaiwen Zhou, Chengzhi Liu, Xuandong Zhao, Anderson Compalas et al.ICLR 2025
- DynaGuard: A Dynamic Guardian Model With User-Defined PoliciesMonte Hoover, Vatsal Baherwani, Neel Jain, Khalid Saifullah et al.ICLR 2026 · 18 citations
- LlavaGuard: An Open VLM-based Framework for Safeguarding Vision Datasets and ModelsLukas Helff, Felix Friedrich, Manuel Brack, Kristian Kersting et al.ICML 2025
- R2-Guard: Robust Reasoning Enabled LLM Guardrail via Knowledge-Enhanced Logical ReasoningMintong Kang, Bo LiICLR 2025
