Pose-controllable talking face generation by implicitly modularized audio-visual representation
While accurate lip synchronization has been achieved for arbitrary-subject audio-driven
talking face generation, the problem of how to efficiently drive the head pose remains …
talking face generation, the problem of how to efficiently drive the head pose remains …
Ad-nerf: Audio driven neural radiance fields for talking head synthesis
Generating high-fidelity talking head video by fitting with the input audio sequence is a
challenging problem that receives considerable attentions recently. In this paper, we …
challenging problem that receives considerable attentions recently. In this paper, we …
Generating holistic 3d human motion from speech
This work addresses the problem of generating 3D holistic body motions from human
speech. Given a speech recording, we synthesize sequences of 3D body poses, hand …
speech. Given a speech recording, we synthesize sequences of 3D body poses, hand …
Eamm: One-shot emotional talking face via audio-based emotion-aware motion model
Although significant progress has been made to audio-driven talking face generation,
existing methods either neglect facial emotion or cannot be applied to arbitrary subjects. In …
existing methods either neglect facial emotion or cannot be applied to arbitrary subjects. In …
Live speech portraits: real-time photorealistic talking-head animation
To the best of our knowledge, we first present a live system that generates personalized
photorealistic talking-head animation only driven by audio signals at over 30 fps. Our system …
photorealistic talking-head animation only driven by audio signals at over 30 fps. Our system …
Audio-driven emotional video portraits
Despite previous success in generating audio-driven talking heads, most of the previous
studies focus on the correlation between speech content and the mouth shape. Facial …
studies focus on the correlation between speech content and the mouth shape. Facial …