Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation

Our approach takes one frame as identity reference and generates audio-driven talking faces with pose controlled by another pose source video. The mouth shapes of the generated frames are matched with the first row (synced video with audio) while the pose is matched with the bottom row (pose source).