CG-HOI: Contact-Guided 3D Human-Object Interaction Generation

Application to Objects in Static 3D Scene Scans Carry a plastic container Play with a yoga ball Lift a small table Carry a large box Move the chair sideways Figure 1. We present an approach to generate realistic 3D human-object interactions (HOIs), from a text description and given static object geometry to be interacted with (left). Our main insight is to explicitly model contact (visualized as colors on the body mesh, closer contact in red), in tandem with human and object sequences, in a joint diffusion process. In addition to synthesizing HOIs from text, we can also synthesize human motions conditioned on given object trajectories (top right), and generate interactions in static scene scans (bottom right).