home · mobile · calendar · colloquia · 2000-2001 · 

Colloquium - Hirschberg

System Errors and User Corrections in Spoken Dialogue Systems
AT&T Labs -- Research

Understanding how people speak when they interact with spoken dialogue systems is critical to improving the performance of those systems. In this talk, I will describe several experiments on data collected from subjects using TOOT, a system for accessing train information by phone, showing a) that user corrections of system errors differ from other user speech along several prosodic dimensions; and b) that prosodic information, together with other automatically available features, can be used to classify turns as corrections with a high degree of accuracy. I will discuss additional characteristics of user correction behavior that should be useful in designing future dialogue systems. For example, understanding whether speakers are more likely to repeat or rephrase their utterances, add new information or shorten their input, and how system behavior influences these choices, suggests new strategies for appropriate on-line modifications to a dialogue system's interaction strategy or to the recognition procedures it employs. I will describe plans to incorporate our findings into a dialogue system which will handle workshop information requests for a workshop on prosody in speech recognition in 2001. [This is joint work with Diane Litman (AT&T) and Marc Swerts (IPO).]

Hosted by James Martin.
Refreshments will be served immediately following the talk.

Department of Computer Science
University of Colorado Boulder
Boulder, CO 80309-0430 USA
May 5, 2012 (14:13)