Deepfakes generation and detection: State-of-the-art, open challenges, countermeasures, and way forward

M Masood, M Nawaz, KM Malik, A Javed, A Irtaza… - Applied …, 2023 - Springer
Easy access to audio-visual content on social media, combined with the availability of
modern tools such as Tensorflow or Keras, and open-source trained models, along with …

State of the art on monocular 3D face reconstruction, tracking, and applications

M Zollhöfer, J Thies, P Garrido, D Bradley… - Computer graphics …, 2018 - Wiley Online Library
The computer graphics and vision communities have dedicated long standing efforts in
building computerized tools for reconstructing, tracking, and analyzing human faces based …

Dynamic neural radiance fields for monocular 4d facial avatar reconstruction

G Gafni, J Thies, M Zollhofer… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present dynamic neural radiance fields for modeling the appearance and dynamics of a
human face. Digitally modeling and reconstructing a talking human is a key building-block …

Face2face: Real-time face capture and reenactment of rgb videos

J Thies, M Zollhofer, M Stamminger… - Proceedings of the …, 2016 - openaccess.thecvf.com
We present a novel approach for real-time facial reenactment of a monocular target video
sequence (eg, Youtube video). The source sequence is also a monocular video stream …

Faceforensics++: Learning to detect manipulated facial images

A Rossler, D Cozzolino, L Verdoliva… - Proceedings of the …, 2019 - openaccess.thecvf.com
The rapid progress in synthetic image generation and manipulation has now come to a point
where it raises significant concerns for the implications towards society. At best, this leads to …

Synthesizing obama: learning lip sync from audio

S Suwajanakorn, SM Seitz… - ACM Transactions on …, 2017 - dl.acm.org
Given audio of President Barack Obama, we synthesize a high quality video of him speaking
with accurate lip sync, composited into a target video clip. Trained on many hours of his …

Neural head avatars from monocular rgb videos

PW Grassal, M Prinzler, T Leistner… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract We present Neural Head Avatars, a novel neural representation that explicitly
models the surface geometry and appearance of an animatable human avatar that can be …

Deep video portraits

H Kim, P Garrido, A Tewari, W Xu, J Thies… - ACM transactions on …, 2018 - dl.acm.org
We present a novel approach that enables photo-realistic re-animation of portrait videos
using only an input video. In contrast to existing approaches that are restricted to …

Makelttalk: speaker-aware talking-head animation

Y Zhou, X Han, E Shechtman, J Echevarria… - ACM Transactions On …, 2020 - dl.acm.org
We present a method that generates expressive talking-head videos from a single facial
image with audio as the only input. In contrast to previous attempts to learn direct map**s …

Live speech portraits: real-time photorealistic talking-head animation

Y Lu, J Chai, X Cao - ACM Transactions on Graphics (ToG), 2021 - dl.acm.org
To the best of our knowledge, we first present a live system that generates personalized
photorealistic talking-head animation only driven by audio signals at over 30 fps. Our system …