Handling speech input in the Ritel QA dialogue system (2009)
Boris Van Schooten, Sophie Rosset, Olivier Galibert, Aurélien Max, Gabriel Illouz
The Ritel system aims to provide open-domain question answering to casual users by means of a telephone dialogue. This implies some unique challenges, such as very fast overall performance and...
Jordi Turmo, Pere Comas, Sophie Rosset, Lori Lamel, Nicolas Moreau, Djamel Mostefa
This paper describes the experience of QAST 2008, the second time a pilot track of CLEF has been held aiming to evaluate the task of Question Answering in Speech Transcripts. Five sites submitted...
The PEACE SLDS understanding evaluation paradigm of the French MEDIA campaign (2007)
Laurence Devillers, Hélène Maynard, Patrick Paroubek, Sophie Rosset
This paper presents a paradigm for evaluating the context-sensitive understanding capability of any spoken language dialog system: PEACE (French acronym for Paradigme d’Evaluation Automatique de la...
Automatic detection of dialog acts based on multi-level information (2004)
Recently there has been growing interest in using dialog acts to characterize human-human and human-machine dialogs. This paper reports on our experience in the annotation and the automatic detection...
Maynard, Hélène, Mctait, Kevin, Mostefa, Djamel, Devillers, Laurence, Rosset, Sophie, Paroubek, Patrick, ...
This paper presents and reports on the progress of the EVALDA/MEDIA project, focusing on the recording protocol of the reference dialogue corpus. The aim of this project is to define and test an...
Maynard, Hélène, Mctait, Kevin, Mostefa, Djamel, Devillers, Laurence, Rosset, Sophie, Paroubek, Patrick, ...
This paper presents and reports on the progress of the EVALDA/MEDIA project, focusing on the recording protocol of the reference dialogue corpus. The aim of this project is to define and test an...
Semantic and dialogic annotation for automated multilingual customer service (2003)
Hilda Hardy, Kirk Baker, Hélène Bonneau-maynard, Laurence Devillers, Sophie Rosset, Tomek Strzalkowski
One central goal of the AMITIÉS multilingual humancomputer dialogue project is to create a dialogue management system capable of engaging the user in human-like conversation in a specific domain. To...
Jean-yves Antoine, Caroline Bousquet-vernhettes, Jérôme Goulian, Mohamed Zakaria, Sophie Rosset, Nadine Vigouroux, ...
This paper presents a new paradigm of “challenge ” evaluation of Spoken Language Understanding. This methodology aims at a quantitative assessment with a high diagnostic power, by opposition with...
Multi-layer Dialogue Annotation for Automated Multilingual (2002)
Customer Service Hilda, Hilda Hardy, Kirk Baker, Laurence Devillers, Lori Lamel, Sophie Rosset, ...
For the AMITIS multilingual human-computer dialogue project [1], we have developed new methods for the manual annotation of spoken dialogue transcriptions from European financial call centers on...
Considerations in the design and evaluation of spoken language dialog systems (2000)
Lori Lamel, Sophie Rosset, Jean-luc Gauvain
In this paper we summarize our experience at LIMSI in the design, development and evaluation of spoken language dialog systems for information retrieval tasks. This work has been for the most part...