Abstract

Non-verbal communication plays an important role in human communication. The KBS department of TU Delft University is interested in developing multi-modal systems, that will get closer and closer to making the interaction with the computer more human. From facial expressions and speech recognition, to eyes tracking and sign language communication, all these ways create a larger environment in the interaction with the user.
An uni modal system was created, based on the iconic communication - which means that the user will communicate data only by using an international approved language, which are the icons. The situation considered was the one of a crisis, which includes explosions, fire, flood, car crashes, and so on.