A Multilingual Embodied Conversational Agent for Tutoring Speech and Language Learning (2009)
Dominic W. Massaro, Ying Liu, Trevor H. Chen, Charles Perfetti
Speech and language science and technology evolved under the assumption that speech was a solely auditory event. However, a burgeoning record of research findings reveals that our perception and...
David Mioduser, Tom Trabasso, John Sabatini, Dominic W. Massaro
Fifteen thousand years ago, the Paleolithic denizens of the Lascaux, Pechmerle or Altamira caves labored to represent aspects of reality which were vital to their life: the animals on which they fed....
A Multilingual Embodied Conversational Agent for Tutoring Speech and Language Learning (2008)
Dominic W. Massaro, Ying Liu, Trevor H. Chen, Charles Perfetti
Speech and language science and technology evolved under the assumption that speech was a solely auditory event. However, a burgeoning record of research findings reveals that our perception and...
Model Selection in AVSP: Some Old and Not So Old News (2008)
We reiterate a paradigm of inquiry in auditory visual speech processing, focusing on appropriate experimental procedures and methods of model selection. Several methods of model selection find...
Sciences (ICPhS'03). Barcelona, Spain. Internationalization of a Talking Head (2008)
Slim Ouni, Dominic W. Massaro, Michael M. Cohen, Karl Young, Ra Jesse
In this paper we describe a general scheme for internationalization of our talking head, Baldi, to speak other languages. We describe the modular structure of the auditory/visual synthesis software....
Dominic W. Massaro, Dominic W. Massaro, Michael M. Cohen
Theories of speech perception, like most theories, have tended to be qualitative rather than quantitative. Progress in the field requires sufficiently detailed experiments and results to allow the...
Perceiving Talking Faces: Insights into Auditory Attention (2008)
Abstract: Perceives naturally integrate auditory from the voice and visual information from the face in the perception of speech and emotion. Although both modalities contribute to perception,...
Featural Evaluation, Integration, and Judgment of Facial Affect (2008)
John W. Euison, Dominic W. Massaro
The paradigm of the fuzzy logical model of perception (FLMP) is extended to the domain of perception and recognition of facial affect. Two experiments were performed using a highly realistic...
Massaro, Dominic W., Jesse, Alexandra
Understanding the lyrics of many contemporary songs is difficult, and an earlier study [Hidalgo-Barnes, M., Massaro, D.W., 2007. Read my lips: an animated face helps communicate musical lyrics....
The Paradigm and FLMP are Alive and Well (2007)
Dominic W. Massaro, Dominic W. Massaro, Dominic W. Massaro, Dominic W. Massaro, Michael M. Cohen, Michael M. Cohen, ...
Cutting, Bruno, Brady, and Moore (1992) criticize our paradigm for inquiry and the fuzzy logical model of perception (FLMP). We reply to their remarks and show a) that the properties of our paradigm...
Dominic W. Massaro, Dominic W. Massaro, Michael M. Cohen
Theories of speech perception, like most theories, have tended to be qualitative rather than quantitative. Progress in the field requires sufficiently detailed experiments and results to allow the...
Chapter for F. G. Ashby (Ed.) Multidimensional Models of Perception and Cognition. We (2007)
Michael M. Cohen, Michael M. Cohen, Dominic W. Massaro
thank Greg Ashby, an anonymous reviewer, and Antoinette Gesi for their helpful comments. The
Psychonomic Bulletin & Review (2007)
Dominic W. Massaro, Michael M. Cohen, Christopher S. Campbell, Tony Rodriguez
Bayes factor of model selection validates FLMP The fuzzy logical model of perception (FLMP; Massaro, 1998) has consistently provided a good description of a variety of results in bimodal speech...
logical model of bimodal emotion perception: Comment on ``The perception of emotions by ear and by eye’ ’ by de Gelder and Vroomen
DISCRIMINATING VISIBLE SPEECH TOKENS USING MULTI-MODALITY (2007)
Christopher S. Campbell, Michael M. Shafae, Suresh K. Lodha, Dominic W. Massaro
We present a multimodal interactive data exploration tool that facilitates discrimination between visible speech tokens. The multimodal tool uses visualization and sonification (non-speech sound) of...
Send correspondence to: (2007)
Joanna Light, Dominic W. Massaro, Dominic W. Massaro
The goal of this study was to test the effectiveness of a Language Wizard/Player with Baldi, a computer-animated tutor, for teaching new vocabulary items to children with a hearing loss. Eight...
Demonstrations of Dialogue Design Tools in the CSLU Toolkit (2007)
Ron Cole, Jacques De Villiers, Kal Shobaki, Dominic W. Massaro, Jonas Beskow, Michael M. Cohen
The CSLU Toolkit and accompanying tutorials are designed to provide a platform for researching and developing language technologies and systems, and to engage naïve users in using and experimenting...
Perceiving Prosody from the Face (2007)
And Voice Istinguishing, Ravindra J. Srinivasan, Dominic W. Massaro
We examined the processing of potential auditory and visual cues that differentiate statements from echoic questions. In Experiment 1, four natural speech statement-question pairs were identified by...
From Multisensory Integration to Talking Heads and Language Learning (2007)
Dominic W. Massaro, W. Massaro, Psychoacoustic Accounts
Introduction Speech is Special (SiS) Theories of Speech Perception Psychoacoustic Accounts Motor Theory A Paradigm for Psychological Inquiry Demonstration Experiment: Varying the Ambiguity of the...
Interactive Learning Tools for Human Language Technology (2007)
Ron Cole Dominic, Ron Cole, Dominic W. Massaro, Dan Jurafsky, Lecia J. Barker
Developing an accessible curriculum of laboratory courses for undergraduate students is vital to progress in human language technology. In this article, we describe means to provide students with...
A Computer-Animated Tutor for Spoken and Written Language Learning (2007)
Baldi, a computer-animated talking head is introduced. The quality of his visible speech has been repeatedly modified and evaluated to accurately simulate naturally talking humans. Baldi's...
Trevor H. Chen, Dominic W. Massaro, Dominic W. Massaro
This study examined the nature of speech perception of native Mandarin-Chinese and American-English speakers by using synthetic visual and auditory continua (from /ba/ to /da/) in an...
Slim Ouni, Michael M. Cohen, Hope Ishak, Dominic W. Massaro
Animated agents are becoming increasingly frequent in research and applications in speech science. An important challenge is to evaluate the effectiveness of the agent in terms of the intelligibility...
Slim Ouni, Michael M. Cohen, Hope Ishak, Dominic W. Massaro
Animated agents are becoming increasingly frequent in research and applications in speech science. An important challenge is to evaluate the effectiveness of the agent in terms of the intelligibility...
A Multilingual Embodied Conversational Agent (2005)
Dominic W. Massaro, Slim Ouni, Michael M. Cohen, Rashid Clark
In our paper last year [1], we described our languagetraining program, which utilizes Baldi as a tutor, who guides students through a variety of exercises designed to teach vocabulary and grammar, to...
Abstract Training Baldi to be multilingual: A case study for an Arabic Badr (2004)
Slim Ouni, Michael M. Cohen, Dominic W. Massaro
In this paper, we describe research to extend the capability of an existing talking head, Baldi, to be multilingual. We use parsimonious client/server architecture to impose autonomy in the...
One of the implicit assumptions of multi-modal interfaces is that human-computer interaction is significantly facilitated by providing multiple input and output modalities. Surprisingly, however,...
Symbiotic Value of an Embodied Agent in Language Learning (2004)
Our perception and understanding are influenced by a speaker's face and accompanying gestures, as well as the actual sound of the speech. Given the value of face-toface interaction, our...
Symbiotic value of an embodied agent in language learning (2004)
Our perception and understanding are influenced by a Espeaker's face and accompanying gestures, as well as the actual sound of the speech. Given the value of face-toface interaction, our...
Development and evaluation of a computer-animated tutor for language and vocabulary learning (2003)
Dominic W. Massaro, Alexis Bosseler, Joanna Light
After making the case for the value of the direct teaching of vocabulary and computer-aided instruction, we review two studies using a Language Wizard/Player for teaching new vocabulary items to hard...
Training a talking head (2002)
Slim Ouni, Dominic W. Massaro, Michael M. Cohen, Karl Young, Ra Jesse
In this paper we describe a general scheme for internationalization of our talking head, Baldi, to speak other languages. We describe the modular structure of the auditory/visual synthesis software....
Training a talking head (2002)
Michael M. Cohen, Dominic W. Massaro, Rashid Clark
A Cyberware laser scan of DWM was made, Baldi’s generic morphology was mapped into the form of DWM, this head was trained on real data recorded with Optotrak LED markers, and the quality of its...
Baldini: Baldi Speaks Italian! (2002)
Piero Cosi, Michael M. Cohen, Dominic W. Massaro
In this work, the development of Baldini, an Italian version of Baldi, a computer-animated conversational agent, is presented.
Modeling Face Identification Processing in Children and Adults (2001)
Gudrun Schwarzer, Dominic W. Massaro
ecognition tasks (for an overview see Flin & Dziurawiec, 1989). Although these differences could be differences in information processing of faces, current research does not offer a definite...
The Processing Of Information From Multiple Sources In Simultaneous Interpreting (2001)
Alexandra Jesse, Ra Jesse, Nick Vrignaud, Michael M. Cohen, Dominic W. Massaro
Language processing is influenced by multiple sources of information. We examined whether the performance in simultaneous interpreting would be improved when providing two sources of information, the...
Developing and Evaluating Conversational Agents (2000)
Dominic W. Massaro, Michael M. Cohen, Jonas Beskow, Sharon Daniel, Ronald A. Cole
Conversation agents present a challenging agenda for research and application. We describe the development, evaluation, and application of Baldi, a computer animated talking head. Baldi's...
From Theory to Practice: Rewards and Challenges (1999)
Dominic W. Massaro, Michael M. Cohen, Jonas Beskow
Language perceivers are viewed as having available multiple sources of information supporting the identification and production of language. This theoretical framework has been successful in...
Ron Cole, Dominic W. Massaro, Jacques De Villiers, Brian Rundle, Khaldoun Shobaki, Johan Wouters, ...
This article describes our experiences with an animated conversational agent being used in daily classroom activities with profoundly deaf children at the Tucker Maxon Oral School in Portland Oregon....
From Theory to Practice: Rewards and Challenges (1999)
Dominic W. Massaro, Michael M. Cohen, Jonas Beskow
Language perceivers are viewed as having available multiple sources of information supporting the identification and production of language. This theoretical framework has been successful in...
Picture My Voice: Audio to Visual Speech Synthesis using Artificial Neural Networks (1999)
Dominic W. Massaro, Jonas Beskow, Michael M. Cohen, Christopher L. Fry, Tony Rodriguez
This paper presents an initial implementation and evaluation of a system that synthesizes visual speech directly from the acoustic waveform. An artifical neural network (ANN) was trained to map the...
Ron Cole, Dominic W. Massaro, Jacques De Villiers, Brian Rundle, Khaldoun Shobaki, Johan Wouters, ...
This article describes our experiences with an animated conversational agent being used in daily classroom activities with profoundly deaf children at the Tucker Maxon Oral School in Portland Oregon....
New tools for interactive speech and language training: Using animated (1999)
Conversational Agents In, Ron Cole, Dominic W. Massaro, Jacques De Villiers, Brian Rundle, Khaldoun Shobaki, ...
This article describes our experiences with an animated conversational agent being used in daily classroom activities with profoundly deaf children at the Tucker Maxon Oral School in Portland Oregon....
Audio To Visual, Dominic W. Massaro, Jonas Beskow, Michael M. Cohen, Christopher L. Fry, Tony Rodriguez
This paper presents an initial implementation and evaluation of a system that synthesizes visual speech directly from the acoustic waveform. An artificial neural network (ANN) was trained to map the...
New tools for interactive speech and language training: Using animated (1999)
Conversational Agents In, Ron Cole, Dominic W. Massaro, Jacques De Villiers, Brian Rundle, Khaldoun Shobaki, ...
This article describes our experiences with an animated conversational agent being used in daily classroom activities with profoundly deaf children at the Tucker Maxon Oral School in Portland Oregon....
Recent developments in facial animation: An inside view (1998)
Michael M. Cohen, Jonas Beskow, Dominic W. Massaro
We report on our recent facial animation work to improve the realism and accuracy of visual speech synthesis. The general approach is to use both static and dynamic observations of natural speech to...
Categorical Perception: Important Phenomenon or Lasting Myth (1998)
Categorical perception, or the perceived equality of instances within a phoneme category, has been a central concept in the experimental and theoretical investigation of speech perception. It can be...
Illusions And Issues In Bimodal Speech Perception (1998)
Dominic Massaro Perceptual, Dominic W. Massaro
As witnessed by this conference and many other sources of evidence, the study of bimodal speech perception has attained the status of a cottage industry. The addition of just one more modality has...
Recent Developments In Facial Animation: An Inside View (1998)
Michael Cohen Jonas, Michael M. Cohen, Jonas Beskow, Dominic W. Massaro
We report on our recent facial animation work to improve the realism and accuracy of visual speech synthesis. The general approach is to use both static and dynamic observations of natural speech to...
Laterality in visual speech perception (1998)
Dominic W. Massaro, Michael M. Cohen, Anne C. Sittig, Anne C. Sittig, ...
The lateralization of visual speech perception was examined in 3 experiments. Participants were presented with a realistic computer-animated face articulating 1 of 4 consonant-vowel syllables without...
Auditory /visual speech in multimodal human interfaces (1994)
Dominic W. Massaro, Michael M. Cohen
It has long been a hope, expectation, and prediction that speech would be the primary medium of communication between humans and machines. To date, this dream has not been realized. We predict that...
Modeling Coarticulation in Synthetic Visual Speech (1993)
Michael M. Cohen, Dominic W. Massaro
After describing the importance of visual information in speech perception and sketching the history of visual speech synthesis, we consider a number of theories of coarticulation in human speech. An...
Modeling Coarticulation in Synthetic Visual Speech (1993)
Michael M. Cohen, Dominic W. Massaro
After describing the importance of visual information in speech perception and sketching the history of visual speech synthesis, we consider a number of theories of coarticulation in human speech. An...
On the Similarity of Categorization Models (1992)
Dominic W. Massaro, Michael M. Cohen, Michael M. Cohen
this paper and the writing of the paper were supported, in part, by grants to Dominic W. Massaro from the Public Health Service (PHS R01 NS 20314), the National Science Foundation (BNS 8812728), a...
A Pattern Recognition Account of Decision Making (1988)
Dominic W. Massaro, Dominic W. Massaro, Dan Friedman, Jim Greeno, Danny Kahneman, ...
In the domain of pattern recognition, experiments have shown perceivers integrate multiple sources of information in an optimal manner. In contrast, other research has been interpreted to mean that...
Plenum Publishing Corporation 653 (1986)
Journal Of Autism, Alexis Bosseler, Dominic W. Massaro
this article two experiments using Baldi to carry out language tutoring for children with autism
What can Visual Speech Synthesis tell Visual Speech Recognition?
Michael Cohen And, Michael M. Cohen, Dominic W. Massaro
We consider the problem of speech recognition given visual and auditory information, and discuss some of the ways that speech synthesis can provide assistance. Three possible contributions of...
What can Visual Speech Synthesis tell Visual Speech Recognition?
Michael M. Cohen, Dominic W. Massaro
We consider the problem of speech recognition given visual and auditory information, and discuss some of the ways that speech synthesis can provide assistance. Three possible contributions of...