Using aerial and geometric features in automatic lip-reading

title: Using aerial and geometric features in automatic lip-reading
author(s): Jacek C. Wojdel and Leon J.M. Rothkrantz
published in: September 2001
appeared in: Proceedings of the 7th European conference on Speech communication and technology (EUROSPEECH 2001)
Aalborg, Denmark
PostScript (516 KB)

Abstract

In this paper we present the lip-reading experiments with different sets of the features extracted from the video sequence. In our experiments we use a simple color based filtering technique to extract the feature vectors from the incoming video signal. Some of those features are directly related to the geometrical properties op the lips (their position and visible thickness). Other features represent the information that relates to the visibility of the other components of the speech production system. The visibility of the teeth and vocal tract for example is described by means of the area they occupy in the image, we call them therefore the aerial features.

 
blue line
University logo