This paper presents a review of promising techniques for very low bit-rate, below 64 kb/s,
image sequence coding. Image sequence coding at such low rates will be a crucial …

This comprehensive work provides the fundamentals of computer facial animation and
brings into sharper focus techniques that are becoming mainstream in the industry. Over the …

We review recent research that examines audio-visual integration in multimodal
communication. The topics include bimodality in human speech, human and automated lip …

We have reported activities in audiovisual speech processing, with emphasis on lip reading
and lip synchronization. These research results have shown that, with lip reading, it is …

The paper gives an overview of model-based approaches applied to image coding, by
looking at image source models. In these model-based schemes, which are different from …

This paper reviews key attributes of neural processing essential to intelligent multimedia
processing (IMP). The objective is to show why neural networks (NNs) are a core technology …

We present a theory for the optimal bit allocation among quadtree (QT) segmentation,
displacement vector field (DVF), and displaced frame difference (DFD). The theory is …

We describe a robust method for locating and tracking lips in gray-level image sequences.
Our approach learns patterns of shape variability from a training set which constrains the …

Speech intelligibility can be improved by adding lip images to the speech signal. Thus lip
movement synthesis plays an important role to realize a natural human-like face of computer …

In this paper, we introduce profile view (PV) lip reading, a scheme for speaker-dependent
isolated word speech recognition. We provide historic motivation for PV from the importance …