A review on deep learning techniques for video prediction

S Oprea, P Martinez-Gonzalez… - … on Pattern Analysis …, 2020 - ieeexplore.ieee.org
The ability to predict, anticipate and reason about future outcomes is a key component of
intelligent decision-making systems. In light of the success of deep learning in computer …

A dynamic multi-scale voxel flow network for video prediction

X Hu, Z Huang, A Huang, J Xu… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
The performance of video prediction has been greatly boosted by advanced deep neural
networks. However, most of the current methods suffer from large model sizes and require …

Predrnn: A recurrent neural network for spatiotemporal predictive learning

Y Wang, H Wu, J Zhang, Z Gao, J Wang… - … on Pattern Analysis …, 2022 - ieeexplore.ieee.org
The predictive learning of spatiotemporal sequences aims to generate future images by
learning from the historical context, where the visual dynamics are believed to have modular …

Dragnuwa: Fine-grained control in video generation by integrating text, image, and trajectory

S Yin, C Wu, J Liang, J Shi, H Li, G Ming… - arxiv preprint arxiv …, 2023 - arxiv.org
Controllable video generation has gained significant attention in recent years. However, two
main limitations persist: Firstly, most existing works focus on either text, image, or trajectory …

Dense optical tracking: Connecting the dots

G Le Moing, J Ponce, C Schmid - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Recent approaches to point tracking are able to recover the trajectory of any scene point
through a large portion of a video despite the presence of occlusions. They are however too …

Video prediction recalling long-term motion context via memory alignment learning

S Lee, HG Kim, DH Choi, HI Kim… - Proceedings of the …, 2021 - openaccess.thecvf.com
Our work addresses long-term motion context issues for predicting future frames. To predict
the future precisely, it is required to capture which long-term motion context (eg, walking or …

Stochastic latent residual video prediction

JY Franceschi, E Delasalles, M Chen… - International …, 2020 - proceedings.mlr.press
Designing video prediction models that account for the inherent uncertainty of the future is
challenging. Most works in the literature are based on stochastic image-autoregressive …

Make it move: controllable image-to-video generation with text descriptions

Y Hu, C Luo, Z Chen - … of the IEEE/CVF Conference on …, 2022 - openaccess.thecvf.com
Generating controllable videos conforming to user intentions is an appealing yet challenging
topic in computer vision. To enable maneuverable control in line with user intentions, a …

Ccvs: Context-aware controllable video synthesis

G Le Moing, J Ponce, C Schmid - Advances in Neural …, 2021 - proceedings.neurips.cc
This presentation introduces a self-supervised learning approach to the synthesis of new
videos clips from old ones, with several new key elements for improved spatial resolution …

Pastnet: Introducing physical inductive biases for spatio-temporal video prediction

H Wu, F Xu, C Chen, XS Hua, X Luo… - Proceedings of the 32nd …, 2024 - dl.acm.org
In this paper, we investigate the challenge of spatio-temporal video prediction, which
involves generating future videos based on historical data streams. Existing approaches …