Gesture Phrase BOUNDARY.21.088 (2009)
One of the ways in which gesture supplements communication is by helping to identify the “meta-data ” that comprises the organizational structure of the discourse. One such type of meta-data is...
Gestural Cohesion for Topic Segmentation (2009)
Jacob Eisenstein, Regina Barzilay, All Davis
This paper explores the relationship between discourse segmentation and coverbal gesture. Introducing the idea of gestural cohesion, we show that coherent topic segments are characterized by...
Debugging Shape Definitions for use in Sketch Recognition (2008)
What: We are building a graphical tool to aid in the creation and debugging of LADDER [1] shape definitions, which are written by developers for use in a domain independent sketch recognition system....
Sketch Recognition in Software Design (2008)
Tracy Hammond, Krzysztof Gajos, All Davis, Howard Shrobe
The Problem: Sketching is a natural and integral part of software design. Software developers use sketching to aid in the brainstorming of ideas, visualizing programming organization, and...
Mutual Disambiguation of Verbal and Sketching Inputs in a Design Environment (2008)
Aaron Adler, All Davis, Howard Shrobe
The Problem: In any design environment, some things are more easily expressed verbally, while some are more easily expressed visually in a sketch. We would like to provide a design environment where...
Interfaces to mechanical design systems seriously limit the user’s creativity, while freehand drawing does not allow the user to interact with his sketch as a mechanical system. We would like to...
Turning Lectures into Comic Books Using Linguistically Salient Gestures (2008)
Jacob Eisenstein, Regina Barzilay, All Davis
Creating video recordings of events such as lectures or meetings is increasingly inexpensive and easy. However, reviewing the content of such video may be time-consuming and difficult. Our goal is to...
Testing Shape Descriptions by Automatically Translating them for Use in Sketch Recognition (2008)
What: We present a translator which takes symbolic descriptions of how shapes are drawn, displayed, and edited in a domain and automatically translates them into shape recognizers, editing...
Gestural Cohesion for Topic Segmentation (2008)
Jacob Eisenstein, Regina Barzilay, All Davis
This paper explores the relationship between discourse structure and coverbal gesture. Using the idea of gestural cohesion, we show that coherent topic segments are characterized by homogeneous...
ABSTRACT HMM-Based Efficient Sketch Recognition (2008)
Tevfik Metin Sezgin, All Davis
This paper shows how viewing sketching as an interactive process allows us to model and recognize sketches using Hidden Markov Models. With the increasing availability of tablet notebooks and...
Using Speech and Sketching in a Design Environment (2008)
What: While sketches are widely used in the early stages of design, not all aspects of a design are easily sketched; some are more easily described verbally. We will create a more natural interaction...
H.5.1 [Information Interfaces and Presentation]: (2008)
Classification of natural hand gestures is usually approached by applying pattern recognition to the movements of the hand. However, the gesture categories most frequently cited in the psychology...
Current computer-based design tools for mechanical engineers are not tailored to the early stages of design. Most designs start as pencil and paper sketches, and are entered into CAD systems only...
Terry Winograd, All Davis, Stuart Dreyfus, Brian Smith, Randall Davis
We arc in the midst of a great wave of enthusiasm about the potential for expert systems in every area of human life and work. There is no agreement, however, as to just how much they can do, and...
Recognizing Text Similarity (2008)
Ozlem Uzuner, All Davis, Boris Katz
Overview: There are a variety of circumstances under which it would be useful to determine that two documents contain similar text, including detecting plagiarism and copyright infringement, and...
Discourse topic and gestural form (2008)
Jacob Eisenstein, Regina Barzilay, All Davis
Coverbal gesture provides a channel for the visual expression of ideas. While some gestural emblems have culturally predefined forms (e.g., “thumbs up”), the relationship between gesture and...
We have created LADDER, the first language to describe how sketched diagrams in a domain are drawn, displayed, and edited. The difficulty in creating such a language is choosing a set of predefined...
Representations for Reasoning About Change (2007)
ABSTRACT: This paper explores representations used to reason about objects which change over time and the processes which cause changes. Specifically, we are interested in solving a problem known as...
Supporting Group Brainstorming (2007)
The Problem: Group brainstorming is most effective when its environment captures the ideas its participants generate in a useful form. We seek to develop such a computer-supported environment to...
Conditional modality fusion for coreference resolution (2007)
Non-verbal modalities such as gesture can improve processing of spontaneous spoken language. For example, similar hand gestures tend to predict semantic similarity, so features that quantify gestural...
Conditional modality fusion for coreference resolution (2007)
Non-verbal modalities such as gesture can improve processing of spontaneous spoken language. For example, similar hand gestures tend to predict semantic similarity, so features that quantify gestural...
Gesture improves coreference resolution (2006)
Coreference resolution, like many problems in natural language processing, has most often been explored using datasets of written text. While spontaneous spoken language poses well-known challenges,...
Gesture features for coreference resolution (2006)
Abstract. If gesture communicates semantics, as argued by many psychologists, then it should be relevant to bridging the gap between syntax and semantics in natural language processing. One benchmark...
Gesture improves coreference resolution (2006)
Coreference resolution, like many problems in natural language processing, has most often been explored using datasets of written text. While spontaneous spoken language poses well-known challenges,...
Gesture features for coreference resolution (2006)
Abstract. If gesture communicates semantics, as argued by many psychologists, then it should be relevant to bridging the gap between syntax and semantics in natural language processing. One benchmark...
Gestural cues for sentence segmentation (2005)
In human-human dialogues, face-to-face meetings are often preferred over phone conversations. One explanation is that non-verbal modalities such as gesture provide additional information, making...
Speech and Sketching for Multimodal Design (2004)
While sketches are commonly and effectively used in the early stages of design, some information is far more easily conveyed verbally than by sketching. In response, we have combined sketching with...
LADDER: A sketch recognition language (2004)
What: We have created LADDER [5], a language to describe how sketched diagrams in a domain are drawn, displayed, and edited. The difficulty in creating such a language is choosing a set of predefined...
Using empirical methods for evaluating expression and content similarity (2004)
Ozlem Uzuner, All Davis, Boris Katz
Despite lack of any significant quantifiable similarities between documents, people can intuitively compare documents and evaluate their similarity. To understand how people evaluate text similarity,...
ShaDy: A shape description debugger for use in sketch recognition (2004)
Sketch recognition systems are currently being developed for many domains, but can be time consuming to build if they are to handle the intricacies of each domain. LADDER is a language for describing...
Automatically transforming symbolic shape descriptions for use in sketch recognition (2004)
Sketch recognition systems are currently being developed for many domains, but can be time consuming to build if they are to handle the intricacies of each domain. This paper presents the first...
Using Empirical Methods for Evaluating Expression and Content Similarity (2004)
Ozlem Uzuner, Randall Davis, All Davis, Boris Katz
Despite lack of any significant quantifiable similarities between documents, people can intuitively compare documents and evaluate their similarity. To understand how people evaluate text similarity,...
ShaDy: A shape description debugger for use in sketch recognition (2004)
Sketch recognition systems are currently being developed for many domains, but can be time consuming to build if they are to handle the intricacies of each domain. LADDER is a language for describing...
R.: Scale-space based feature point detection for digital ink (2004)
Tevfik Metin Sezgin, All Davis
The Problem: We are building systems that support sketch-based interaction with computers. Part of the foundation for these systems is a module that takes freehand strokes consisting of a series of...
Content and Expression-Based Copy Recognition for Intellectual Property Protection (2003)
Özlem Uzuner, Randall Davis, All Davis
Protection of copyrights and revenues of content owners in the digital world has been gaining importance in the recent years. This paper presents a way of fingerprinting text documents that can be...
Ozlem Uzuner, Randall Davis, All Davis
Recent technological developments have created new challenges for the protection and enforcement of intellectual property rights. The amendments to existing legislation in response to these...
A framework for multi-domain sketch recognition (2002)
Christine Alvarado, Michael Oltmans, All Davis
People use sketches to express and record their ideas in many domains, including mechanical engineering, software design, and information architecture. Unfortunately, most computer programs cannot...
A framework for multi-domain sketch recognition (2002)
Christine Alvarado, Michael Oltmans, All Davis
People use sketches to express and record their ideas in many domains, including mechanical engineering, software design, and information architecture. Unfortunately, most computer programs cannot...
A framework for multi-domain sketch recognition (2002)
We present a multi-domain architecture for sketch recognition systems that we believe will make these systems both easier to construct and more robust in operation.
Tahuti: A geometrical sketch recognition system for uml class diagrams (2002)
We have created and tested Tahuti, a dual-view sketch recognition environment for class diagrams in UML. The system is based on a multi-layer recognition framework which recognizes multi-stroke...
Generating domain specific sketch recognizers from object descriptions (2002)
Tevfik Metin Sezgin, All Davis
The Problem: We use sketches as a medium for expressing ideas and saving thoughts. Sketching is especially common in early design as a means of communication, documentation and as a tool for...
A domain description language for sketch recognition (2002)
The Problem: Pervasive environments, complete with digital whiteboards and pocket PC’s, have increasingly included applications with sketchable interfaces. Sketch recognition applications built for...
Query by attention: Visually searchable information maps (2001)
The Problem and Motivation: Vast amounts of useful information are accessible to us in textual databases, yet we prefer graphs, charts, and maps to interpret this information and make decisions. One...
Preserving the freedom of paper in a computerbased sketch tool (2001)
Christine J. Alvarado, All Davis
The tradeoff between the ease of sketching a mechanical system on paper and the power of representing it on a computer is too great, as evidenced by the fact that mechanical designers typically begin...
Resolving ambiguities to create a natural computer-based sketching environment (2001)
Current computer-based design tools for mechanical engineers are not tailored to the early stages of design. Most designs start as pencil and paper sketches, and are entered into CAD systems only...
Query by attention: Visually searchable information maps (2001)
This paper explores how the design of information spaces might be grounded in knowledge of human visual processing, notably what kinds of visual selection are most efficient. Information maps...
Early processing in sketch understanding (2001)
Tevfik Metin Sezgin, All Davis
The Problem: Freehand sketching is both a natural and crucial part of design, yet is almost totally unsupported by current design automation software. We are combining the flexibility and ease of use...
Resolving ambiguities to create a natural computer-based sketching environment (2001)
Christine J. Alvarado, All Davis
Abstract. Current computer-based design tools for mechanical engineers are not tailored to the early stages of design. Most designs start as pencil and paper sketches, and are entered into CAD...
Generating multiple new designs from a sketch (1998)
Thomas F. Stahovich, All Davis, Howard Shrobe
We describe a program called SketchIT that transforms a single sketch of a mechanical device into multiple families of new designs. It represents each of these families with a “BEP-Model,” a...
Generating Multiple New Designs From a Sketch (1996)
Thomas F. Stahovich, Randall Davis, All Davis, Howard Shrobe
We describe a program called SketchIT that transforms a single sketch of a mechanical device into multiple families of new designs. It represents each of these families with a "BEP-Model,"...
What is a knowledge representation (1993)
All Davis, Howard Shrobe, Peter Szolovits
■ Although knowledge representation is one of the central and, in some ways, most familiar concepts in AI, the most fundamental question about it—What is it?—has rarely been answered directly....
What is a knowledge representation (1993)
All Davis, Howard Shrobe, Peter Szolovits
■ Although knowledge representation is one of the central and, in some ways, most familiar concepts in AI, the most fundamental question about it—What is it?—has rarely been answered directly....
What is a knowledge representation (1993)
All Davis, Howard Shrobe, Peter Szolovits
■ Although knowledge representation is one of the central and, in some ways, most familiar concepts in AI, the most fundamental question about it—What is it?—has rarely been answered directly....
All Davis, Aaron Adler, Christine Alvarado, Tracy Hammond, Rebecca Hitchcock, Michael Oltmans, ...
The Problem: Computer aided design tools built to date have typically shared three important characteristics: (i), they are intended for use relatively late in the design process, (ii) they typically...
The Problem: Computer aided design tools built to date have typically shared three important characteristics: (i), they are intended for use relatively late in the design process, (ii) they typically...