An end-to-end review of gaze estimation and its interactive applications on handheld mobile devices

Y Lei, S He, M Khamis, J Ye - ACM Computing Surveys, 2023 - dl.acm.org
In recent years, we have witnessed an increasing number of interactive systems on
handheld mobile devices which utilise gaze as a single or complementary interaction …

Progressive disentangled representation learning for fine-grained controllable talking head synthesis

D Wang, Y Deng, Z Yin, HY Shum… - Proceedings of the …, 2023 - openaccess.thecvf.com
We present a novel one-shot talking head synthesis method that achieves disentangled and
fine-grained control over lip motion, eye gaze&blink, head pose, and emotional expression …

Liveportrait: Efficient portrait animation with stitching and retargeting control

J Guo, D Zhang, X Liu, Z Zhong, Y Zhang… - arxiv preprint arxiv …, 2024 - arxiv.org
Portrait Animation aims to synthesize a lifelike video from a single source image, using it as
an appearance reference, with motion (ie, facial expressions and head pose) derived from a …

Talking head generation with probabilistic audio-to-visual diffusion priors

Z Yu, Z Yin, D Zhou, D Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
We introduce a novel framework for one-shot audio-driven talking head generation. Unlike
prior works that require additional driving sources for controlled synthesis in a deterministic …

Rank-n-contrast: learning continuous representations for regression

K Zha, P Cao, J Son, Y Yang… - Advances in Neural …, 2024 - proceedings.neurips.cc
Deep regression models typically learn in an end-to-end fashion without explicitly
emphasizing a regression-aware representation. Consequently, the learned representations …

EG-Net: Appearance-based eye gaze estimation using an efficient gaze network with attention mechanism

X Wu, L Li, H Zhu, G Zhou, L Li, F Su, S He… - Expert Systems with …, 2024 - Elsevier
Gaze estimation, which has a wide range of applications in many scenarios, is a challenging
task due to various unconstrained conditions. As information from both full-face and eye …

Supervised contrastive regression

K Zha, P Cao, Y Yang, D Katabi - arxiv preprint arxiv:2210.01189, 2022 - arxiv.org
Deep regression models typically learn in an end-to-end fashion and do not explicitly try to
learn a regression-aware representation. Their representations tend to be fragmented and …

End-to-end video gaze estimation via capturing head-face-eye spatial-temporal interaction context

Y Guan, Z Chen, W Zeng, Z Cao… - IEEE Signal Processing …, 2023 - ieeexplore.ieee.org
In this letter, we propose a new method, Multi-Clue Gaze (MCGaze), to facilitate video gaze
estimation via capturing spatial-temporal interaction context among head, face, and eye in …

An extensive analysis of different approaches to driver gaze classification

S Camberg, E Hüllermeier - IEEE Transactions on Intelligent …, 2024 - ieeexplore.ieee.org
Driver Monitoring Systems (DMS) enable Intelligent Vehicles to capture the in-cabin scene
and help determine the driver's level of attention and ability to take over. The task of driver …

Where Deepfakes Gaze at? Spatial-Temporal Gaze Inconsistency Analysis for Video Face Forgery Detection

C Peng, Z Miao, D Liu, N Wang, R Hu… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
With the continuous development of generative models on face generation, how to
distinguish the real and fake face has become an important problem for security. Because of …