Audio to body dynamics

E Shlizerman, L Dery, H Schoen… - Proceedings of the …, 2018 - openaccess.thecvf.com
We present a method that gets as input an audio of violin or piano playing, and outputs a
video of skeleton predictions which are further used to animate an avatar. The key idea is to …

[PDF][PDF] Write-a-video: computational video montage from themed text.

M Wang, GW Yang, SM Hu, ST Yau… - ACM Trans …, 2019 - cg.cs.tsinghua.edu.cn
Intelligent tools that assist inexperienced users in creative processes are becoming more
abundant: for image editing, for drawing and even for 3D modeling and fabrication. One …

Visual rhythm and beat

A Davis, M Agrawala - ACM Transactions on Graphics (TOG), 2018 - dl.acm.org
We present a visual analogue for musical rhythm derived from an analysis of motion in
video, and show that alignment of visual rhythm with its musical counterpart results in the …

Autotransition: Learning to recommend video transition effects

Y Shen, L Zhang, K Xu, X ** - European Conference on Computer Vision, 2022 - Springer
Video transition effects are widely used in video editing to connect shots for creating
cohesive and visually appealing videos. However, it is challenging for non-professionals to …

Eventfulness for interactive video alignment

J Sun, L Deng, T Afouras, A Owens… - ACM Transactions on …, 2023 - dl.acm.org
Humans are remarkably sensitive to the alignment of visual events with other stimuli, which
makes synchronization one of the hardest tasks in video editing. A key observation of our …

[HTML][HTML] An Audiovisual Correlation Matching Method Based on Fine-Grained Emotion and Feature Fusion

Z Su, Y Feng, J Liu, J Peng, W Jiang, J Liu - Sensors, 2024 - mdpi.com
Most existing intelligent editing tools for music and video rely on the cross-modal matching
technology of the affective consistency or the similarity of feature representations. However …

DanceIt: music-inspired dancing video synthesis

X Guo, Y Zhao, J Li - IEEE Transactions on Image Processing, 2021 - ieeexplore.ieee.org
Close your eyes and listen to music, one can easily imagine an actor dancing rhythmically
along with the music. These dance movements are usually made up of dance movements …

VCoME: Verbal Video Composition with Multimodal Editing Effects

W Gong, X **, X Li, D He, X Wu - arxiv preprint arxiv:2407.04697, 2024 - arxiv.org
Verbal videos, featuring voice-overs or text overlays, provide valuable content but present
significant challenges in composition, especially when incorporating editing effects to …

Chromatic framework for quantum movies and applications in creating montages

F Yan, S Jiao, AM Iliyasu, Z Jiang - Frontiers of Computer Science, 2018 - Springer
A framework that introduces chromatic considerations to earlier descriptions of movies on
quantum computers is proposed. This chromatic framework for quantum movies (CFQM) …

Suggesting sounds for images from video collections

M Soler, JC Bazin, O Wang, A Krause… - … October 8-10 and 15-16 …, 2016 - Springer
Given a still image, humans can easily think of a sound associated with this image. For
instance, people might associate the picture of a car with the sound of a car engine. In this …