Text2HOI: Text-Guided 3D Motion Generation for Hand-Object Interaction

Hand over an apple with both hands." "Open a box with the right hand." Time Figure 1 . Given a text and a canonical object mesh as prompts, we generate 3D motion for hand-object interaction without requiring object trajectory and initial hand pose. We represent the right hand with a light skin color and the left hand with a dark skin color. The articulation of a box in the first row is controlled by estimating an angle for the pre-defined axis of the box.