U$ina Prototynical Obiects to Imolement Shared Behavior in Obiect Oriented Systems (2009)
with practical consequences A traditional philosophical controversy between representing general concepts as abstract sets or classes and representing concepts as concrete prowrypes is reflected in a...
Back into Equilibrium: Balancing the Ordinary and the Extraordinary (2009)
Science and Art are both about the balance between the ordinary and the extraordinary. Science and Art both begin by removing us from our everyday experience. The concepts they introduce are often...
The Continuing Quest for Abstraction (ECOOP 20 th Anniversary Panel) (2009)
Abstract. The history of Object-Oriented Programming can be interpreted as a continuing quest to capture the notion of abstraction – to create computational artifacts that represent the essential...
Abstract Your Memory, Connected (2009)
Edward Shen, Pattie Maes, Henry Lieberman
“Your memory, connected ” is a series of three images generated by a net.art generator we designed and implemented with natural language processing and common sense reasoning techniques developed...
Understanding and Debugging System Configuration (2008)
It is a daily challenge for system operators to keep track of the changes made to a system. In fact, recent investigation has found that system operators often have incorrect mental models of the...
Understanding and Debugging System Configuration (2008)
A system’s current state is the result of changes made to its configuration over time. Operators now make these changes manually, or use scripts to automate them. Without extreme discipline,...
COMPUTERS From Whole Earth to the Whole Web (2008)
We’re pretty damn lucky we got the Internet we did: a worldwide network in which almost anybody can read, publish, and program pretty much anything. It didn’t have to turn out that way. It could...
Semantic Web: Why, What, and How? (2008)
Dieter Fensel, Jim Hendler, Henry Lieberman, Wolfgang Wahlster
Using Common Sense for Planning Learning Activities (2008)
Aparecido Fabiano, Pinatti Carvalho, Junia Coutinho Anacleto, Henry Lieberman, De Souza Godoi, Silvia Zem-mascarenhas
This paper discusses how common sense knowledge can be used by instructors for planning Learning Activities. Using common sense statements which were automatically collected, we are developing...
� Visual Generalization in PBE Systems (2008)
Robert St. Amant, Henry Lieberman, Richard Potter, Luke Zettlemoyer
� Programming by example: visual generalization in programming by example
Scenario-Oriented Recommendation (2008)
Edward Shen, Henry Lieberman, Francis Lam
What am I gonna wear?:
1. THE CRISIS IN CONSUMER ELECTRONICS INTERFACES (2008)
Henry Lieberman, José Espinosa
We are reaching a crisis with design of user interfaces for consumer electronics. Flashing 12:00 time indicators, push-andhold buttons, and interminable modes and menus are all symptoms of trying to...
Using Common Sense for Planning Learning Activities (2008)
Aparecido Fabiano, Pinatti Carvalho, Junia Coutinho Anacleto, Henry Lieberman, De Souza Godoi, Silvia Zem-mascarenhas
This paper discusses how common sense knowledge can be used by instructors for planning Learning Activities. Using common sense statements which were automatically collected, we are developing...
End-User Software Engineering Position Paper PERSONAL WORK (2008)
My goal is to make the process of programming easier, especially for people who are not necessarily specialists in computer science. Why is it so much harder to program a computer than simply to use...
One of the biggest unaddressed challenges for the digital economy is what to do when electronic transactions go wrong. Consumers are frustrated by interminable phone menus, and long delays to problem...
Categories and Subject Descriptors H.5.4 [Information Interfaces and Presentation]: (2008)
Earl Wagner, Henry Lieberman, General Terms, Human Factors
We demonstrate Woodstein, a software agent that tracks user interaction with e-commerce Web sites through a browser, and relates the browsing events to high-level models of complex, multi-step...
NLP (Natural Language Processing) for NLP (Natural Language Programming) (2008)
Rada Mihalcea, Hugo Liu, Henry Lieberman
Abstract. Natural Language Processing holds great promise for making computer interfaces that are easier to use for people, since people will (hopefully) be able to talk to the computer in their own...
Art Imitates Life: Programming by Example as an Imitation Game (2008)
Introduction Having the computer imitate recorded human actions is the basis for an experimental technology for programming, variously called "Programming by Example" or "Programming...
Static and Dynamic Semantics of the Web (2008)
C. Fry, Mike Plusch, Henry Lieberman
this paper, we discuss the need for dynamic semantics, and show how dynamic semantics will be enabled by and useful to the new generation of intelligent agent software that will increasingly inhabit...
Will Software Ever Work? (2008)
Henry Lieberman, Christopher Fry
Introduction Will software ever work? No, not if it's "business as usual" in the software industry. But we could make it work. In the rest of this issue, you'll hear some amazing...
Computer-Aided Design Of User Interfaces By Example (2008)
A promising approach to Computer-Aided Design of User Interfaces (CADUI) is Programming by Example, where an interface designer demonstrates the behavior of an interface by presenting concrete...
Kyunghee Kim, Rosalind W. Picard, Henry Lieberman
People on the autistic spectrum often have difficulties with social interaction, and these difficulties are compounded when a person faces the uncertainty of not knowing what to expect in a new...
Usable AI Requires Commonsense Knowledge (2008)
Artificial Intelligence techniques are increasingly being applied to the user interface, as evidenced by growing numbers of CHI papers which have some AI aspect, and standalone conferences on the...
Interaction Is The Key To Machine Learning Applications (2007)
Henry Lieberman Media, Henry Lieberman
. The traditional field of Machine Learning is concerned with techniques for modifying the behavior of a computer agent over time in order to improve its usefulness to people. This problem has...
Interaction Is The Key To Machine Learning Applications (2007)
. The traditional field of Machine Learning is concerned with techniques for modifying the behavior of a computer agent over time in order to improve its usefulness to people. This problem has...
Marcottage: A Navigational Approach to Object Networks (2007)
te is preserved, and information is copied only as needed to maintain this illusion. This incremental change operation is useful, for example, in making private annotations to hypermedia networks,...
ZStep 95: A Reversible, Animated Source Code Stepper (2007)
Henry Lieberman, Christopher Fry
this paper. It is important not only to "back up" variables to their previous values, but also to "back up" a consistent view of the user interface, including static code, dynamic...
One of the biggest unaddressed challenges for the digital economy is what to do when electronic transactions go wrong. Consumers are frustrated by interminable phone menus, and long delays to problem...
Creating of Semantic Web (2007)
Dieter Fensel, Dieter Fensel, Jim Hendler, Jim Hendler, Henry Lieberman, Henry Lieberman, ...
The World-wide Web (WWW) has drastically changed the availability of electronically available information.
Twelve Training Aging, Henry Lieberman, Bonnie A. Nardi, David J. Wright
Color profile: Generic CMYK printer profile Composite Default screen 228 Your Wish is My Command An important function of an agent is to be “on the lookout ” for bits of information that are...
Please start by looking at page 2. You should look at it in page layout mode. (2007)
Zstep Is Program, Henry Lieberman, Christopher Fry
this paper. It is important not only to "back up" variables to their previous values, but also to "back up" a consistent view of the user interface, including static code, dynamic...
Common Consensus: a webbased game for collecting commonsense goals. Paper presented at IUI’07 (2007)
In our research on Commonsense reasoning, we have found that an especially important kind of knowledge is knowledge about human goals. Especially when applying Commonsense reasoning to interface...
and Principal Component Analysis (2007)
Robert Speer, Henry Lieberman, Robert Speer
In this thesis, I present a system for reasoning with common sense knowledge in multiple natural languages, as part of the Open Mind Common Sense project. The knowledge that Open Mind collects from...
Common Consensus: a webbased game for collecting commonsense goals. Paper presented at IUI’07 (2007)
In our research on Commonsense reasoning, we have found that an especially important kind of knowledge is knowledge about human goals. Especially when applying Commonsense reasoning to interface...
End-User Software Engineering Position Paper (2007)
End-user software engineering position paper.
A goal-oriented Web browser (2006)
Many users are familiar with the interesting but limited functionality of Data Detector interfaces like Microsoft’s Smart Tags and Google's AutoLink. In this paper we significantly expand the...
Can common sense uncover cultural differences in computer applications (2006)
Junia Anacleto, Henry Lieberman, Marie Tsutsumi, Vânia Neris, Aparecido Carvalho, Jose Espinosa, ...
Abstract. Cultural differences play a very important role in matching computer interfaces to the expectations of users from different national and cultural backgrounds. But to date, there has been...
Optical character recognition · Scripting · Multimodal (2006)
Henry Lieberman, Amy Chu, A. Chu
Abstract Users often have tasks that can be accomplished with the aid of multiple media – for example with text, sound and pictures. For example, communicating an urban navigation route can be...
Leonardo Bonanni, Jose H. Espinosa, Henry Lieberman, Ted Selker
Networked appliances might make them aware of each other, but interacting with a complex network can be difficult in itself. KitchenSense is a sensor rich networked kitchen research platform that...
Can common sense uncover cultural differences in computer applications (2006)
Junia Anacleto, Henry Lieberman, Marie Tsutsumi, Vânia Neris, Aparecido Carvalho, Jose Espinosa, ...
Abstract. Cultural differences play a very important role in matching computer interfaces to the expectations of users from different national and cultural backgrounds. But to date, there has been...
Providing expert advice by analogy for on-line help (2005)
Henry Lieberman, Ashwani Kumar
One of the principal problems of online help is the mismatch between the specialized knowledge and technical vocabulary of experts who are providing the help, and the relative naïveté of novices,...
How to Wreck a Nice Beach You Sing Calm Incense (2005)
Henry Lieberman, Er Faaborg, Waseem Daher, José Espinosa
A principal problem in speech recognition is distinguishing between words and phrases that sound similar but have different meanings. Speech recognition programs produce a list of weighted candidate...
EventNet: Inferring Temporal Relations Between Commonsense Events (2005)
Jose Espinosa, Henry Lieberman
Abstract. In this paper, we describe EventNet, a toolkit for inferring temporal relations between Commonsense events. It comprises 10,000 nodes and 30,000 temporal links mined from the Openmind...
Common Sense Investing: Bridging the Gap Between Expert and Novice (2004)
Ashwani Kumar, Sharad C. Sundararajan, Henry Lieberman
In this paper, we describe Common Sense Investing (CSI), an interactive investment tool that uses a knowledge base of common sense statements in conjunction with domain knowledge to assist personal...
Supporting User Hypotheses in Problem Diagnosis on the Web and Elsewhere (2004)
Earl J. Wagner, Henry Lieberman
People are performing increasingly complicated actions on the web, such as automated purchases involving multiple sites. Web services will only increase the complexity of these interactions. Things...
A commonsense approach to predictive text entry (2004)
Tom Stocky, Er Faaborg, Henry Lieberman
People cannot type as fast as they think, especially when faced with the constraints of mobile devices. There have been numerous approaches to solving this problem, including research in augmented...
Beating common sense into interactive applications (2004)
Henry Lieberman, Hugo Liu, Push Singh, Barbara Barry
■ A long-standing dream of artificial intelligence has been to put commonsense knowledge into computers—enabling machines to reason about everyday life. Some projects, such as Cyc, have begun to...
Common Sense Investing: Bridging the Gap Between Expert and Novice (2004)
Ashwani Kumar, Sharad C. Sundararajan, Henry Lieberman
In this paper, we describe Common Sense Investing (CSI), an interactive investment tool that uses a knowledge base of common sense statements in conjunction with domain knowledge to assist personal...
Toward a Programmatic Semantics of Natural Language (2004)
Natural language is imbued with a rich semantics but unfortunately its complex elegance is often mistaken for mere imprecision. Because complete parsers of English are not yet achievable, people...
Common Sense on the Go: Giving Mobile Applications an Understanding of Everyday Life (2004)
Henry Lieberman, Er Faaborg, José Espinosa, Tom Stocky
Mobile devices such as cell phones and PDAs present unique challenges and opportunities. The challenge is that user interaction is limited by small screens and keyboards (if the device has them at...
A model of textual affect sensing using real-world knowledge (2003)
Hugo Liu, Henry Lieberman, Ted Selker
This paper presents a novel way for assessing the affective qualities of natural language and a scenario for its use. Previous approaches to textual affect sensing have employed keyword spotting,...
End-User Debugging for Electronic Commerce (2003)
Henry Lieberman And, Henry Lieberman, Earl Wagner
One of the biggest unaddressed challenges for the digital economy is what to do when electronic transactions go wrong. Currently, consumers are frustrated by interminable phone menus and long delays...
Visualizing the Affective Structure of a Text Document (2003)
Hugo Liu, Ted Selker, Henry Lieberman
This paper introduces an approach for graphically visualizing the affective structure of a text document. A document is first affectively analyzed using a unique textual affect sensing engine, which...
Woodstein: A Web Interface Agent for Debugging E-Commerce (2003)
Henry Lieberman, Earl Joseph Wagner, Earl Joseph Wagner
Woodstein is a software agent that works with a user's web browser to explain and help diagnose problems in web processes, such as purchases. It enables the user to inspect data items in...
Spinning the Semantic Web (2003)
Dieter Fensel, Jim Hendler, Henry Lieberman, Wolfgang Wahlster
The World Wide Web (WWW) has drastically changed the availability of electronically accessible information. Currently there are around three billion static documents in the WWW that are used by more...
A model of textual affect sensing using real-world knowledge (2003)
Hugo Liu, Henry Lieberman, Ted Selker
This paper presents a novel way for assessing the affective qualities of natural language and a scenario for its use. Previous approaches to textual affect sensing have employed keyword spotting,...
A Zero-input Interface for Leveraging Group Experience (2003)
Taly Sharon, Henry Lieberman, Ted Selker
The experience of a trusted group of colleagues can help users improve the quality and focus of their browsing and searching activities. How could a system provide such help, when and where the users...
Robust photo retrieval using world semantics (2002)
Photos annotated with textual keywords can be thought of as resembling documents, and querying for photos by keywords is akin to the information retrieval done by search engines. A common approach to...
Adaptive Linking between Text and Photos Using Common Sense Reasoning (2002)
Abstract. In a hypermedia authoring task, an author often wants to set up meaningful connections between different media, such as text and photographs. To facilitate this task, it is helpful to have...
GOOSE: A Goal-Oriented Search Engine With Commonsense (2002)
Hugo Liu, Henry Lieberman, Ted Selker
Abstract. A novice search engine user may find searching the web for information difficult and frustrating because she may naturally express search goals rather than the topic keywords search engines...
Searching the Web with a Little Help from your Friends (2002)
Taly Sharon, Henry Lieberman, Ted Selker
When browsing the Web, users have limited knowledge about the quality of the information they view. Implementing a system to address this issue usually requires active information gathering and the...
Out of Many, One: Reliable Results from Unreliable Recognition (2002)
Recognition technologies such as speech recognition and optical recognition are still, by themselves. not reliable enough for many practical uses in user interfaces However, by combining input from...
Intelligent Agent Software for Medicine (2002)
An important trend for the future of health technology will be the increasing use of intelligent agent software for medical applications. As the complexity of situations faced by both patients and...
GOOSE: A Goal-Oriented Search Engine with Commonsense (2002)
Hugo Liu, Henry Lieberman, Ted Selker
A novice search engine user may find searching the web for information difficult and frustrating because she may naturally express search goals rather than the topic keywords search engines need. In...
Robust photo retrieval using world semantics (2002)
Photos annotated with textual keywords can be thought of as resembling documents, and querying for photos by keywords is akin to the information retrieval done by search engines. A common approach to...
GOOSE: A Goal-Oriented Search Engine With Commonsense (2002)
Hugo Liu, Henry Lieberman, Ted Selker
Abstract. A novice search engine user may find searching the web for information difficult and frustrating because she may naturally express search goals rather than the topic keywords search engines...
Adaptive Linking between Text and Photos Using Common Sense Reasoning (2002)
Abstract. In a hypermedia authoring task, an author often wants to set up meaningful connections between different media, such as text and photographs. To facilitate this task, it is helpful to have...
Programming by Demonstration: a Machine Learning Approach (2001)
Tessa Lau, Tessa Lau, Daniel S. Weld, Daniel S. Weld, Pedro Domingos, Pedro Domingos, ...
Programming by Demonstration: a Machine Learning Approach by Tessa Lau Co-Chairs of Supervisory Committee: Professor Daniel S. Weld Department of Computer Science & Engineering Assistant...
Co-Chairs of Supervisory Committee: (2001)
Tessa Lau, Tessa Lau, Daniel S. Weld, Pedro Domingos, Daniel S. Weld, Pedro Domingos, ...
and have found that it is complete and satisfactory in all respects,
Interfaces that give and take advice (2001)
Why is almost every kind of input by a human to a computer referred to as a “command”? This strikes up the image of the user as a military commander issuing orders, and the computer as an...
Visual Generalization in Programming by Example (2000)
Robert St. Amant, Henry Lieberman, Richard Potter, Luke Zettlemoyer
In Programming by Example [PBE, also sometimes called "Programming by Demonstration"] systems, the system records actions performed by a user in the interface, and produces a...
Butterfly: A Conversation-Finding Agent for Internet Relay Chat (1999)
The Internet enables groups of people throughout the world to interact to discuss issues, get assistance, learn, and socialize. However, when there are thousands of loosely defined groups in which a...
Let's Browse: A Collaborative Web Browsing Agent (1999)
Web browsing, like most of today's desktop applications, is usually a solitary activity. Other forms of media, such as watching television, are often done by groups of people, such as families...
Let's Browse: A Collaborative Web Browsing Agent (1999)
Henry Lieberman, Neil Van Dyke, Adriana Vivacqua
Web browsing, like most of today's desktop applications, is usually a solitary activity. Other forms of media, such as watching television, are often done by groups of people, such as families...
Training Agents to Recognize Text by Example (1999)
Henry Lieberman, Bonnie A. Nardi, David Wright
An important function of an agent is to be "on the lookout" for bits of information that are interesting to its user, even if these items appear in the midst of a larger body of...
Abstract Integrating user interface agents with conventional applications (1998)
In most experiments with user interface agents to date, it has been necessary either to implement both the agent and the application from scratch, or to modify the code of an existing application to...
Integrating User Interface Agents with Conventional Applications (1998)
In most experiments with user interface agents to date, it has been necessary either to implement both the agent and the application from scratch, or to modify the code of an existing application to...
Attaching Interface Agent Software to Applications (1998)
There has been much recent interest in the idea of "intelligent interface agent" software. An intelligent agent is software that can take independent actions in the interface on behalf of a...
A multi-scale, multi-layer, translucent virtual space (1997)
The dynamic nature of virtual display spaces can provide powerful tools for helping people comprehend phenomena that occur over widely disparate spatial scales. This paper presents the macroscope, an...
Autonomous Interface Agents (1997)
Two branches of the trend towards "agents" that are gaining currency are interface agents, software that actively assists a user in operating an interactive interface, and autonomous...
The Visual Language of Experts in Graphic Design (1996)
Graphic designers and other visual problem solving experts now routinely use computer-based image-editing tools in their work. Recently, attempts have been made to apply learning and inference...
The Visual Language of Experts in Graphic Design (1996)
Graphic designers and other visual problem solving experts now routinely use computer-based image-editing tools in their work. Recently, attempts have been made to apply learning and inference...
Letizia: An Agent That Assists Web Browsing (1995)
Letizia is a user interface agent that assists a user browsing the World Wide Web. As the user operates a conventional Web browser such as Netscape, the agent tracks user behavior and attempts to...
Bridging the gulf between code and behavior in programming (1995)
Henry Lieberman, Christopher Fry
Program debugging can be an expensive, complex and frustrating process. Conventional programming environments provide little explicit support for the cognitive tasks of diagnosis and visualization...
The visual language of experts in graphic design (1995)
Graphic designers and other visual problem solving experts now routinely use computer-based image-editing tools in their work. Recently, attempts have been made to apply learning and inference...
A User Interface for Knowledge Acquisition from Video (1994)
In conventional knowledge acquisition, a domain expert interacts with a knowledge engineer, who interviews the expert, and codes knowledge about the domain objects and procedures in a rule-based...
Powers of Ten Thousand: Navigating in Large Information Spaces (1994)
How would you interactively browse a very large display space, for example, a street map of the entire United States? The traditional solution is zoom and pan. But each time a zoom-in operation takes...
Partial Editing Of Storyboards For Mondrian (1993)
Henry Lieberman, Leonard A. Gould, Rachel V. Koyfman, Rachel V. Koyfman
Modern graphical editors provide their users with a macro facility, which is a way to record and reuse sequences of commands. As the commands are demonstrated, the feature records the corresponding...
Graphical Annotation as a Visual Language for Specifying Generalization Relations (1993)
This paper explores how graphical annotation can be used as a visual language for specifying interpretations of user actions in an environment for programming by example [or "by...
Dominoes and Storyboards: Beyond "Icons on Strings" (1992)
Practically since graphic displays were first hooked to computers, the idea of representing computer programs by pictures has attracted researchers. However, to date, most proposals for visual...
A Shared View of Sharing: The Treaty of Orlando (1989)
Lynn Andrea Stein, Henry Lieberman, David Ungar
Introduction For the past few years, researchers have been debating the relative merits of object-oriented languages with classes and inheritance as opposed to those with prototypes and delegation....
Concurrent Object-Oriented Programming in Act 1 (1987)
this paper will try to accomplish several goals (in parallel): We will argue that the actor model is an appropriate way to think about parallel computation. Since many actors may be actively sending...
Using Prototypical Objects to Implement Shared Behavior in Object Oriented Systems (1986)
A traditional philosophical controversy between representing general concepts as abstract sets or classes and representing concepts as concrete prototypes is reflected in a controversy between two...
A real-time garbage collector based on the lifetimes of objects (1983)
Henry Lieberman, Carl Hewitt, Danny Hillis
ABSTRACT: In previous heap storage systems, the cost of creating objects and garbage collection is independent of the lifetime of the object. Since objects with short lifetimes account for a large...
Design issues in parallel architectures for artificial intelligence (1983)
Development of highly intelligent computers requires a conceptual foun-dation that will overcome the limitations of the yon Neumann architecture. Architectures for such a foundation should meet the...
A real-time garbage collector based on the lifetimes of objects (1983)
Henry Lieberman, Carl Hewitt, Danny Hillis
ABSTRACT: In previous heap storage systems, the cost of creating objects and garbage collection is independent of the lifetime of the object. Since objects with short lifetimes account for a large...
Will Software Ever Work? (0000)
The article focuses on needs for computer software practices that can reduce errors in software programming. Every computer user has his or her own story of the unreliability of modern software. Many...
Exploring the Web with reconnaissance agents (0000)
This article reports on a new agent technology that helps Internet surfers to scout out the online terrain and recommend the best paths for the user to follow. These agents are called reconnaissance...
The article focuses on the changing face of computer programming The article focuses on the changing face of computer programming. Most computer programmers worked with the help of...
THE Debugging Scandal AND What to Do About It. (0000)
The article discusses about some embarrassing facts about software development, that are faced, in spite of the progress made in field of IT in the past 30 years. Computer programs often don\'t work...
The article focuses on needs for computer software practices that can reduce errors in software programming. Every computer user has his or her own story of the unreliability of modern software. Many...
Exploring the Web with reconnaissance agents
This article reports on a new agent technology that helps Internet surfers to scout out the online terrain and recommend the best paths for the user to follow. These agents are called reconnaissance...
The article focuses on the changing face of computer programming The article focuses on the changing face of computer programming. Most computer programmers worked with the help of...
THE Debugging Scandal AND What to Do About It.
The article discusses about some embarrassing facts about software development, that are faced, in spite of the progress made in field of IT in the past 30 years. Computer programs often don't work...