Music Gesture for Visual Sound Separation

Figure 1: We propose to leverage explicit body dynamics motion cues for visual sound separation in music performances. We show that our new model can perform well on both heterogeneous and homogeneous music separation tasks.