Jacob Eisenstein

XIML: A Universal Language for User Interfaces (2009)

One of the ways in which gesture supplements communication is by helping to identify the “meta-data ” that comprises the organizational structure of the discourse. One such type of meta-data is...

Angel Puerta, Jacob Eisenstein

In recent years, there have been a number of industry and academic efforts to standardize the representation of many types of data in order to facilitate the interoperability of applications. There...

Learning Document-Level Semantic Properties from Free-text Annotations (2009)

Harr Chen, Jacob Eisenstein, Regina Barzilay

This paper demonstrates a new method for leveraging free-text annotations to infer semantic properties of documents. Free-text annotations are becoming increasingly abundant, due to the recent...

Gestural Cohesion for Topic Segmentation (2009)

Device Independence and Extensibility in Gesture Recognition \Lambda (2009)

This paper explores the relationship between discourse segmentation and coverbal gesture. Introducing the idea of gestural cohesion, we show that coherent topic segments are characterized by...

Jacob Eisenstein, Shahram Gh, Leana Golubchik, Cyrus Shahabi, Donghui Yan, Roger Zimmermann

Gesture recognition offers a new medium for human-computer interaction that can be both efficient and highly intuitive. However, gesture recognition software is stillin its infancy. While many...

Semantic Back-Pointers from Gesture (2009)

Device Independence and Extensibility in Gesture Recognition (2009)

Although the natural-language processing community has dedicated much of its focus to text, faceto-face spoken language is ubiquitous, and offers the potential for breakthrough applications in domains

Jacob Eisenstein, Shahram Gh, Leana Golubchik, Cyrus Shahabi, Donghui Yan, Roger Zimmermann

Gesture recognition techniques often suffer from being highly device-dependent and hard to extend. If a system is trained using data from a specific glove input device, that system is typically...

Turning Lectures into Comic Books Using Linguistically Salient Gestures (2008)

Learning Document-Level Semantic Properties from Free-text Annotations (2008)

Creating video recordings of events such as lectures or meetings is increasingly inexpensive and easy. However, reviewing the content of such video may be time-consuming and difficult. Our goal is to...

Harr Chen, Jacob Eisenstein, Regina Barzilay

This paper demonstrates a new method for leveraging unstructured annotations to infer semantic document properties. We consider the domain of product reviews, which are often annotated by their...

Gestural Cohesion for Topic Segmentation (2008)

Gesture in Automatic Discourse Processing (2008)

This paper explores the relationship between discourse structure and coverbal gesture. Using the idea of gestural cohesion, we show that coherent topic segments are characterized by homogeneous...

Gesture in Automatic Discourse Processing (2008)

Computers cannot fully understand spoken language without access to the wide range of modalities that accompany speech. This thesis addresses the particularly expressive modality of hand gesture, and...

H.5.1 [Information Interfaces and Presentation]: (2008)

Computers cannot fully understand spoken language without access to the wide range of modalities that accompany speech. This thesis addresses the particularly expressive modality of hand gesture, and...

Natural Gesture in Descriptive Monologues (2008)

Classification of natural hand gestures is usually approached by applying pattern recognition to the movements of the hand. However, the gesture categories most frequently cited in the psychology...

Jacob Eisenstein, Randall Davis

Gesture plays a prominent role in human-human interaction, and it offers promise as a new modality for human-computer interaction. However, our understanding of gesture is still at an early stage....

A GUI Editor that Generates Tutoring Agents (2008)

Jacob Eisenstein And, Jacob Eisenstein, Charles Rich

Tutoring agents can provide a dynamic and engaging way to help users understand an application. However, integrating tutoring agents into applications is difficult. It requires the expertise to...

Gesture in automatic discourse processing (2008)

Eisenstein, Jacob (Jacob Richard)

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2008.

Gesture in automatic discourse processing (2008)

Eisenstein, Jacob (Jacob Richard)

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2008.

Gesture in Automatic Discourse Processing (2008)

Jacob Eisenstein, Regina Barzilay

Computers cannot fully understand spoken language without access to the wide range of modalities that accompany speech. This thesis addresses the particularly expressive modality of hand gesture, and...

Discourse topic and gestural form (2008)

Device Independence and Extensibility in Gesture Recognition ∗ (2007)

Coverbal gesture provides a channel for the visual expression of ideas. While some gestural emblems have culturally predefined forms (e.g., “thumbs up”), the relationship between gesture and...

Jacob Eisenstein, Shahram Gh, Leana Golubchik, Cyrus Shahabi, Donghui Yan, Roger Zimmermann

Gesture recognition techniques often suffer from being highly device-dependent and hard to extend. If a system is trained using data from a specific glove input device, that system is typically...

Conditional modality fusion for coreference resolution (2007)

Conditional modality fusion for coreference resolution (2007)

Non-verbal modalities such as gesture can improve processing of spontaneous spoken language. For example, similar hand gestures tend to predict semantic similarity, so features that quantify gestural...

Gesture improves coreference resolution (2006)

Non-verbal modalities such as gesture can improve processing of spontaneous spoken language. For example, similar hand gestures tend to predict semantic similarity, so features that quantify gestural...

Gesture features for coreference resolution (2006)

Coreference resolution, like many problems in natural language processing, has most often been explored using datasets of written text. While spontaneous spoken language poses well-known challenges,...

Interacting with communication appliances: An evaluation of two computer vision-based selection techniques (2006)

Abstract. If gesture communicates semantics, as argued by many psychologists, then it should be relevant to bridging the gap between syntax and semantics in natural language processing. One benchmark...

Gesture improves coreference resolution (2006)

Communication appliances, intended for home settings, require intuitive forms of interaction. Computer vision offers a potential solution, but is not yet sufficiently accurate.As interaction...

Gesture features for coreference resolution (2006)

Coreference resolution, like many problems in natural language processing, has most often been explored using datasets of written text. While spontaneous spoken language poses well-known challenges,...

Gestural Cues for Sentence Segmentation (2005)

Abstract. If gesture communicates semantics, as argued by many psychologists, then it should be relevant to bridging the gap between syntax and semantics in natural language processing. One benchmark...

Eisenstein, Jacob, Davis, Randall

In human-human dialogues, face-to-face meetings are often preferred over phone conversations.One explanation is that non-verbal modalities such as gesture provide additionalinformation, making...

Gestural Cues for Sentence Segmentation (2005)

Eisenstein, Jacob, Davis, Randall

In human-human dialogues, face-to-face meetings are often preferred over phone conversations.One explanation is that non-verbal modalities such as gesture provide additionalinformation, making...

Gestural cues for sentence segmentation (2005)

R.: Gestural cues for sentence segmentation (2005)

In human-human dialogues, face-to-face meetings are often preferred over phone conversations. One explanation is that non-verbal modalities such as gesture provide additional information, making...

Jacob Eisenstein, All Davis Abstract

In human-human dialogues, face-to-face meetings are often preferred over phone conversations. One explanation is that non-verbal modalities such as gesture provide additional information, making...

A trimodal dialogue corpus: Speech, gesture, and sketching (2004)

Jacob Eisenstein, Aaron Adler, Lisa Guttentag

The development of perceptual user interfaces is central to Oxygen’s mission of pervasive, human-centered computing. Based on speech, gesture, and sketching – rather than a keyboard and mouse –...

A Salience-Based Approach to Gesture-Speech Alignment (2004)

Jacob Eisenstein And, Jacob Eisenstein, C. Mario Christoudias

One of the first steps towards understanding natural multimodal language is aligning gesture and speech, so that the appropriate gestures ground referential pronouns in the speech.

In this paper, I describe the application of genetic programming to evolve a controller for a robotic tank in a simulated environment. The purpose is to explore how genetic techniques can best be...

In this paper, I describe the application of genetic programming to evolve a controller for a robotic tank in a simulated environment.The purpose is to explore how genetic techniques can best be...

In this paper, I describe the application of genetic programming to evolve a controller for a robotic tank in a simulated environment.The purpose is to explore how genetic techniques can best be...

Evolving robocode tank fighters (2003)

In this paper, I describe the application of genetic programming to evolve a controller for a robotic tank in a simulated environment. The purpose is to explore how genetic techniques can best be...

Developing a Multiple User Interface Representation Framework for Industry (2003)

In this paper, I describe the application of genetic programming to evolve a controller for a robotic tank in a simulated environment. The purpose is to explore how genetic techniques can best be...

Angel Puerta, Jacob Eisenstein, Redwhale Software

As many chapters of this book testify, developing an efficient and intelligent method for designing and running multiple user interfaces is an important research problem. The challenges are many:...

Agents and GUIs from task models (2002)

Charles Rich, Jacob Eisenstein, Jacob Eisenstein

This work unifies two important threads of research in intelligent user interfaces which share the common element of explicit task modeling. On the one hand, longstanding research on task-centered...

Agents and GUIs from task models (2002)

Applying Model-Based Techniques to the Development of UIs for Mobile Computers (2001)

This work unifies two important threads of research in intelligent user interfaces which share the common element of explicit task modeling. On the one hand, longstanding research on task-centered...

Applying Model-Based Techniques to the Development of UIs for Mobile Computers (2001)

Mobile computing poses a series of unique challenges for user interface design and development: user interfaces must now accommodate the capabilities of various access devices and be suitable for...

Applying model-based techniques to the development of UIs for mobile computers (2001)

Mobile computing poses a series of unique challenges for user interface design and development: user interfaces must now accommodate the capabilities of various access devices and be suitable for...

Adapting to Mobile Contexts with User-Interface Modeling (2000)

Mobile computing poses a series of unique challenges for user interface design and development: user interfaces must now accommodate the capabilities of various access devices and be suitable for...

Adapting to Mobile Contexts with User-Interface Modeling (2000)

Mobile computing offers the possibility of dramatically expanding the versatility of computers, by bringing them off the desktop and into new and unique contexts. However, this newfound versatility...

Adapting to mobile contexts with user – interface modelling (2000)

Mobile computing offers the possibility of dramatically expanding the versatility of computers, by bringing them off the desktop and into new and unique contexts. However, this newfound versatility...