Abstract

This is a preliminary report of the OVR Wizard of Oz experiment. This report shows the setup of the experiments, the design of the questionnaires, the construction of the Wizard of Oz setup and the analysis of the analysis of the obtained data from the questionnaires and the recorded dialogues.

The experiment is performed by the Alparon research group of the Knowledge Based Systems group of the Department of Applied Mathematics and Informatics of Delft University of Technology. The experiment was executed in Autumn 1995.

The OVR WOz report contains the following subjects:

• The OVR-WOz experiment: Introduction and Setup.
  This report describes the goals and setup of the experiment and defines the scripts according which the experiments are performed.
• The Appreciation of Inquiry Systems: ASR versus Human Operator.
  Analysis of the Questionnaires, with the introduction of a new scoring method.
• Statistical Analysis of the parallel WOz dialogues.
  Analysis of the corpus of the parallel Wizard of Oz dialogues, in order to get insight in the difference between human-machine and human-human dialogues.