Abstract in English.
Symmetric Multimodal Interaction in a Dynamic Dialogue (2009)
Two important themes in current work on interfaces are multimodal interaction and the use of dialogue. Human multimodal dialogues are symmetric, i.e., both participants communicate multimodally. We...
Mutual Disambiguation of Verbal and Sketching Inputs in a Design Environment (2008)
Aaron Adler, All Davis, Howard Shrobe
The Problem: In any design environment, some things are more easily expressed verbally, while some are more easily expressed visually in a sketch. We would like to provide a design environment where...
Multi-Domain Sketch Recognition (2008)
Metin Sezgin, Olya Veselova, Aaron Adler, Michael Oltmans, Christine Alvarado, Rebecca Hitchcock
In this paper, we describe a new framework for multi-domain sketch recognition which is being developed by the Design Rationale Group at the MIT AI laboratory. The framework uses a blackboard...
Using Speech and Sketching in a Design Environment (2008)
What: While sketches are widely used in the early stages of design, not all aspects of a design are easily sketched; some are more easily described verbally. We will create a more natural interaction...
Design and Systems Engineering of AFRL's Demonstration and Sciences Experiment (2005)
Cohen, Dan, Spanjers, Gregory, Winter, James, Ginet, Gregory, Dichter, Bronislaw, Adler, Aaron, ...
This conference features the work of authors from: Georgia Tech’s Space Systems Design Lab, Aerospace Systems Design Lab, School of Aerospace Engineering, Georgia Tech Research Institute; NASA’s...
Design and Systems Engineering of AFRL's Demonstration and Sciences Experiment (2005)
Cohen, Dan, Spanjers, Gregory, Winter, James, Ginet, Gregory, Dichter, Bronislaw, Adler, Aaron, ...
This conference features the work of authors from: Georgia Tech’s Space Systems Design Lab, Aerospace Systems Design Lab, School of Aerospace Engineering, Georgia Tech Research Institute; NASA’s...
Speech and Sketching for Multimodal Design (2004)
While sketches are commonly and effectively used in the early stages of design, some information is far more easily conveyed verbally than by sketching. In response, we have combined sketching with...
A trimodal dialogue corpus: Speech, gesture, and sketching (2004)
Jacob Eisenstein, Aaron Adler, Lisa Guttentag
The development of perceptual user interfaces is central to Oxygen’s mission of pervasive, human-centered computing. Based on speech, gesture, and sketching – rather than a keyboard and mouse –...
Creating a multimodal design environment using speech and sketching (2003)
Sketches are a commonly used tool in the early stages of design. Our previous system, ASSIST(Alvarado, 2000), lets users sketch in a natural fashion and recognizes mechanical systems. ASSIST also...
Evaluating look-to-talk: A gaze-aware interface in a collaborative environment (2002)
Alice Oh, Harold Fox, Max Van Kleek, Aaron Adler, Krzysztof Gajos, Trevor Darrell
We present “look-to-talk”, a gaze-aware interface for directing a spoken utterance to a software agent in a multiuser collaborative environment. Through a prototype and a Wizard-of-Oz (WOz)...
Evaluating look-to-talk: A gaze-aware interface in a collaborative environment (2002)
Alice Oh, Harold Fox, Max Van Kleek, Aaron Adler, Krzysztof Gajos, Trevor Darrell
We present "look-to-talk", a gaze-aware interface for directing a spoken utterance to a software agent in a multiuser collaborative environment. Through a prototype and a...
Evaluating look-to-talk: A gaze-aware interface in a collaborative environment (2002)
Alice Oh, Harold Fox, Max Van Kleek, Aaron Adler, Krzysztof Gajos, Trevor Darrell
We present “look-to-talk”, a gaze-aware interface for directing a spoken utterance to a software agent in a multiuser collaborative environment. Through a prototype and a Wizard-of-Oz (WOz)...
Evaluating look-to-talk: A gaze-aware interface in a collaborative environment (2002)
Alice Oh, Harold Fox, Max Van Kleek, Aaron Adler, Krzysztof Gajos, Trevor Darrell
We present “look-to-talk”, a gaze-aware interface for directing a spoken utterance to a software agent in a multiuser collaborative environment. Through a prototype and a Wizard-of-Oz (WOz)...
Multi-domain sketch recognition (2002)
Tracy Hammond, Aaron Adler, Michael Oltmans, Christine Alvarado, Rebecca Hitchcock
In this paper, we describe a new framework for multi-domain sketch recognition which is being developed by the Design Rationale Group at the MIT AI laboratory. The framework uses a blackboard...
All Davis, Aaron Adler, Christine Alvarado, Tracy Hammond, Rebecca Hitchcock, Michael Oltmans, ...
The Problem: Computer aided design tools built to date have typically shared three important characteristics: (i), they are intended for use relatively late in the design process, (ii) they typically...