Revideo: Remake a video with motion and content control

C Mou, M Cao, X Wang, Z Zhang… - Advances in Neural …, 2025 - proceedings.neurips.cc
Despite significant advancements in video generation and editing using diffusion models,
achieving accurate and localized video editing remains a substantial challenge …

Mofa-video: Controllable image animation via generative motion field adaptions in frozen image-to-video diffusion model

M Niu, X Cun, X Wang, Y Zhang, Y Shan… - European Conference on …, 2024 - Springer
We present MOFA-Video, an advanced controllable image animation method that generates
video from the given image using various additional controllable signals (such as human …

Tc4d: Trajectory-conditioned text-to-4d generation

S Bahmani, X Liu, W Yifan, I Skorokhodov… - … on Computer Vision, 2024 - Springer
Recent techniques for text-to-4D generation synthesize dynamic 3D scenes using
supervision from pre-trained text-to-video models. However, existing representations, such …

Follow-your-emoji: Fine-controllable and expressive freestyle portrait animation

Y Ma, H Liu, H Wang, H Pan, Y He, J Yuan… - SIGGRAPH Asia 2024 …, 2024 - dl.acm.org
We present Follow-Your-Emoji, a diffusion-based framework for portrait animation, which
animates a reference portrait with target landmark sequences. The main challenge of portrait …

Animatelcm: Accelerating the animation of personalized diffusion models and adapters with decoupled consistency learning

FY Wang, Z Huang, X Shi, W Bian, G Song… - arxiv preprint arxiv …, 2024 - arxiv.org
Video diffusion models has been gaining increasing attention for its ability to produce videos
that are both coherent and of high fidelity. However, the iterative denoising process makes it …

I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models

W Ouyang, Y Dong, L Yang, J Si, X Pan - SIGGRAPH Asia 2024 …, 2024 - dl.acm.org
The remarkable generative capabilities of diffusion models have motivated extensive
research in both image and video editing. Compared to video editing which faces additional …

Be-your-outpainter: Mastering video outpainting through input-specific adaptation

FY Wang, X Wu, Z Huang, X Shi, D Shen… - … on Computer Vision, 2024 - Springer
Video outpainting is a challenging task, aiming at generating video content outside the
viewport of the input video while maintaining inter-frame and intra-frame consistency …

Vbench++: Comprehensive and versatile benchmark suite for video generative models

Z Huang, F Zhang, X Xu, Y He, J Yu, Z Dong… - arxiv preprint arxiv …, 2024 - arxiv.org
Video generation has witnessed significant advancements, yet evaluating these models
remains a challenge. A comprehensive evaluation benchmark for video generation is …

Follow-your-click: Open-domain regional image animation via short prompts

Y Ma, Y He, H Wang, A Wang, C Qi, C Cai, X Li… - arxiv preprint arxiv …, 2024 - arxiv.org
Despite recent advances in image-to-video generation, better controllability and local
animation are less explored. Most existing image-to-video methods are not locally aware …

Motion Prompting: Controlling Video Generation with Motion Trajectories

D Geng, C Herrmann, J Hur, F Cole, S Zhang… - arxiv preprint arxiv …, 2024 - arxiv.org
Motion control is crucial for generating expressive and compelling video content; however,
most existing video generation models rely mainly on text prompts for control, which struggle …