
title: | Using aerial and geometric features in automatic lip-reading |
author(s): | Jacek C. Wojdel and Leon J.M. Rothkrantz |
published in: | September 2001 |
appeared in: |
Proceedings of the 7th European conference on Speech communication and technology (EUROSPEECH 2001) Aalborg, Denmark |
PostScript (516 KB) |

Abstract
In this paper we present the lip-reading experiments with different sets of the features extracted from the video sequence. In our experiments we use a simple color based filtering technique to extract the feature vectors from the incoming video signal. Some of those features are directly related to the geometrical properties op the lips (their position and visible thickness). Other features represent the information that relates to the visibility of the other components of the speech production system. The visibility of the teeth and vocal tract for example is described by means of the area they occupy in the image, we call them therefore the aerial features.