Dynamicrafter: Animating open-domain images with video diffusion priors

J **ng, M **a, Y Zhang, H Chen, W Yu, H Liu… - … on Computer Vision, 2024 - Springer
Animating a still image offers an engaging visual experience. Traditional image animation
techniques mainly focus on animating natural scenes with stochastic dynamics (eg clouds …

Generative image dynamics

Z Li, R Tucker, N Snavely… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
We present an approach to modeling an image-space prior on scene motion. Our prior is
learned from a collection of motion trajectories extracted from real video sequences …

Pia: Your personalized image animator via plug-and-play modules in text-to-image models

Y Zhang, Z **ng, Y Zeng, Y Fang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Recent advancements in personalized text-to-image (T2I) models have revolutionized
content creation empowering non-experts to generate stunning images with unique styles …

Mofa-video: Controllable image animation via generative motion field adaptions in frozen image-to-video diffusion model

M Niu, X Cun, X Wang, Y Zhang, Y Shan… - European Conference on …, 2024 - Springer
We present MOFA-Video, an advanced controllable image animation method that generates
video from the given image using various additional controllable signals (such as human …

Follow-your-click: Open-domain regional image animation via short prompts

Y Ma, Y He, H Wang, A Wang, C Qi, C Cai, X Li… - arxiv preprint arxiv …, 2024 - arxiv.org
Despite recent advances in image-to-video generation, better controllability and local
animation are less explored. Most existing image-to-video methods are not locally aware …

Text-guided synthesis of eulerian cinemagraphs

A Mahapatra, A Siarohin, HY Lee, S Tulyakov… - ACM Transactions on …, 2023 - dl.acm.org
We introduce Text2Cinemagraph, a fully automated method for creating cinemagraphs from
text descriptions---an especially challenging task when prompts feature imaginary elements …

Human image generation: A comprehensive survey

Z Jia, Z Zhang, L Wang, T Tan - ACM Computing Surveys, 2024 - dl.acm.org
Image and video synthesis has become a blooming topic in computer vision and machine
learning communities along with the developments of deep generative models, due to its …

Cinemo: Consistent and controllable image animation with motion diffusion models

X Ma, Y Wang, G Jia, X Chen, YF Li, C Chen… - arxiv preprint arxiv …, 2024 - arxiv.org
Diffusion models have achieved great progress in image animation due to powerful
generative capabilities. However, maintaining spatio-temporal consistency with detailed …

AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidance

Z Dai, Z Zhang, Y Yao, B Qiu, S Zhu, L Qin… - arxiv preprint arxiv …, 2023 - arxiv.org
Image animation is a key task in computer vision which aims to generate dynamic visual
content from static image. Recent image animation methods employ neural based rendering …

Instructional Video Generation

Y Li, Z Cao, JJ Corso - arxiv preprint arxiv:2412.04189, 2024 - arxiv.org
Despite the recent strides in video generation, state-of-the-art methods still struggle with
elements of visual detail. One particularly challenging case is the class of egocentric …