Diffusion models have demonstrated superior performance in the field of portrait animation.
However, current approaches relied on either visual or audio modality to control character …

Human motion video generation has garnered significant research interest due to its broad
applications, enabling innovations such as photorealistic singing heads or dynamic avatars …

Although neural rendering has made significant advancements in creating lifelike,
animatable full-body and head avatars, incorporating detailed expressions into full-body …

We present LatentSync, an end-to-end lip sync framework based on audio conditioned
latent diffusion models without any intermediate motion representation, diverging from …

Speech-driven lip synchronization is a crucial technology for generating realistic facial
animations, with broad application prospects in virtual reality, education, training, and other …