We present a machine learning technique for driving 3D facial animation by audio input in
real time and with low latency. Our deep neural network learns a map** from input …

We live in a world where there are countless interactions with computer systems in every-
day situations. In the most ideal case, this interaction feels as familiar and as natural as the …

This paper presents a complete system for expressive visual text-to-speech (VTTS), which is
capable of producing expressive output, in the form of a'talking head', given an input text and …

An image-based visual speech animation system is presented in this paper. A video model
is proposed to preserve the video dynamics of a talking face. The model represents a video …

The use of visemes as atomic speech units in visual speech analysis and synthesis systems
is well-established. Viseme labels are determined using a many-to-one phoneme-to-viseme …

A controllable computer animated avatar that could be used as a natural user interface for
computers is demonstrated. Driven by text and emotion input, it generates expressive …

When we speak, we configure the vocal tract which shapes the visible motions of the face
and the patterning of the audible speech acoustics. Similarly, we use these visible and …

High quality expressive speech synthesis has been a long-standing goal towards natural
human-computer interaction. Generating a talking head which is both realistic and …

We compare two approaches for synthesizing visual speech using active appearance
models (AAMs): one that utilizes acoustic features as input, and one that utilizes a phonetic …

In this paper we apply speaker-adaptive and speakerdependent training of hidden Markov
models (HMMs) to visual speech synthesis. In speaker-dependent training we use data from …