CVPR2025

GROVE: A Generalized Reward for Learning Open-Vocabulary Physical Skill

Jieming Cui, Tengyu Liu, Ziyu Meng, Jiale Yu, Ran Song, Wei Zhang, Yixin Zhu, Siyuan Huang

Abstract

GROVE Figure 1 . Open-vocabulary physical skills learned with our generalized reward framework GROVE. The white humanoid mannequins demonstrate diverse skills from abstract instructions (e.g., "conduct the orchestra," "position body in a shape of C") using a pre-trained controller. The system also generalizes to standard RL benchmarks, including the Ant, Humanoid, and quadrupedal ANYmal, all without task-specific reward engineering.