Abstract A Course on Digital Video Special Effects (2008)
Irfan A. Essa, Gabriel J. Brostow
We present a brief overview of our course "Digital Video Special Effects ” taught in the College of Computing at Georgia Institute of Technology. This course is offered as an elective at...
Controlled Animation of Video Sprites (2008)
Input Sequence, Arno Schödl, Irfan A. Essa
velocity vector Figure 1: Creating an animation from video sprite samples. We introduce a new optimization algorithm for video sprites to animate realistic-looking characters. Video sprites are...
Localization and 3D Reconstruction of Urban Scenes Using GPS (2008)
Kim, Kihwan, Summet, Jay, Starner, Thad, Ashbrook, Daniel, Kapade, Mrunal, Essa, Irfan A.
Using off-the-shelf Global Positioning System (GPS) units, we reconstruct buildings in 3D by exploiting the reduction in signal to noise ratio (SNR) that occurs when the buildings obstruct the...
Remixing Authorship: Reconfiguring the Author in Online Video Remix Culture (2007)
Diakopoulos, Nicholas, Luther, Kurt, Medynskiy, Yevgeniy (Eugene), Essa, Irfan A.
In an abstract sense, authorship entails the constrained selection or generation of media and the organization and layout of that media in a larger structure. But authorship is more than just...
Aware Home: Sensing, Interpretation, and Recognition of Everday Activities (2005)
Presentation given in the Wilby Room of the Georgia Tech Library and Information Center.
A Bayesian View of Boosting and Its Extension (2005)
Bobick, Aaron F., Essa, Irfan A., Shi, Yifan
In this paper, we provide a Bayesian perspective of boosting framework, which we refer to as Bayesian Integration. Through this perspective, we prove the standard ADABOOST is a special case of the...
TV Watcher: Distributed Media Analysis and Correlation (2004)
Hilley, David Byron, El-Helw, Ahmed, Wolenetz, Matthew David, Essa, Irfan A., Hutto, Phillip W., Starner, Thad E., ...
The explosion of available content in broadcast media has created a desperate need for applications and prerequisite system architectures to support automatic capture, filtration, categorization,...
TV Watcher: Distributed Media Analysis and Correlation (2004)
Hilley, David Byron, El-Helw, Ahmed, Wolenetz, Matthew David, Essa, Irfan A., Hutto, Phillip W., Starner, Thad, ...
The explosion of available content in broadcast media has created a desperate need for applications and prerequisite system architectures to support automatic capture, filtration, categorization,...
Novel skeletal representation for articulated creatures (2004)
Advisor Prof, Irfan A. Essa, Gabriel J. Brostow, Gabriel J. Brostow
Managed PhD and MEng students in joint research projects on motion analysis, forensics, image synthesis, and deformable 3D surface capture. Co-PI on object recognition grant.
Novel skeletal representation for articulated creatures (2004)
Advisor Prof, Irfan A. Essa, Gabriel J. Brostow, Gabriel J. Brostow
Performed research on locating people in dense crowds by analyzing motion. Examined uses of interactive texture synthesis for digital photography.
Fast Multiple Camera Head Pose Tracking (2003)
Ravikrishna Ruddarraju, Antonio Haro, Irfan A. Essa
This paper presents a multiple camera system to determine the head pose of people in an indoor setting. Our approach extends current eye tracking techniques from a single camera system to a multiple...
Perceptual User Interfaces using Vision-based Eye Tracking (2003)
Ravikrishna Ruddarraju, Antonio Haro, Ravikrishna Ruddarraju†antonio Haro, Kris Nagel, Quan T. Tran, Gregory Abowd, ...
We present a multi-camera vision-based eye tracking method to robustly locate and track user's eyes as they interact with an application. We propose enhancements to various visionbased...
Choreography Driven Characters (2002)
Sternberg, Daniel, Essa, Irfan A.
High-level control of an articulated humanoid character for animation is much desired by animators. Current options of key-framing, motion capture and simulation either give too much or too little...
Exemplar Based Non-parametric BRDFs (2002)
Realistic rendering of computer modeled three dimensional surfaces typically involves building a parameterized model of the bidirectional reflectance distribution function (BRDF) of the desired...
Choreography Driven Characters (2002)
Sternberg, Daniel, Essa, Irfan A.
High-level control of an articulated humanoid character for animation is much desired by animators. Current options of key-framing, motion capture and simulation either give too much or too little...
Exemplar Based Non-parametric BRDFs (2002)
Realistic rendering of computer modeled three dimensional surfaces typically involves building a parameterized model of the bidirectional reflectance distribution function (BRDF) of the desired...
Real-time, Photo-realistic, Physically Based Rendering of Fine Sacle Human Skin Structure (2001)
Haro, Antonio, Guenter, Brian K., Essa, Irfan A.
Brian Guenter (Microsoft)
Visual Coding and Tracking of Speech Related Facial Motion (2001)
Reveret, Lionel, Essa, Irfan A.
This article present a visual characterization of facial motions inherent with speaking. We propose a set of four Facial Speech Parameters (FSP): jaw opening, lips rounding, lips closure, and lips...
Mandatory Human Participation: A New Scheme for Building Secure Systems (2001)
Xu, Jun, Essa, Irfan A., Sung, Min-Ho, Lipton, Richard J.
Mandatory Human Participation (MHP) is a novel authentication scheme that asks the question "are you human?" (instead of "who are you?"), and upon the correct answer to this question, can prove a...
Real-time, Photo-realistic, Physically Based Rendering of Fine Sacle Human Skin Structure (2001)
Haro, Antonio, Guenter, Brian K., Essa, Irfan A.
Brian Guenter (Microsoft)
Visual Coding and Tracking of Speech Related Facial Motion (2001)
Reveret, Lionel, Essa, Irfan A.
This article present a visual characterization of facial motions inherent with speaking. We propose a set of four Facial Speech Parameters (FSP): jaw opening, lips rounding, lips closure, and lips...
Mandatory Human Participation: A New Scheme for Building Secure Systems (2001)
Xu, Jun, Essa, Irfan A., Sung, Min-Ho, Lipton, Richard J.
Mandatory Human Participation (MHP) is a novel authentication scheme that asks the question "are you human?" (instead of "who are you?"), and upon the correct answer to this question, can prove a...
Machine Learning for Video-Based Rendering (2000)
We recently introduced a new paradigm for computer animation, video textures, which allows us to use a recorded video to generate novel animations by replaying the video samples in a new order. Video...
Xu, Jun, Essa, Irfan A., Lipton, Richard J.
In this paper, we propose the concept of a humanizer and explore its applications in network security and E-commerce. A humanizer is a novel authentication scheme that asks the question "are you...
Gregory D. Abowd, Christopher G. Atkeson, Aaron E Bobick, Irfan A. Essa, Blair Macintyre Elizabeth
The Future Computing Environments (FCE) Group at Georgia Tech is a collection of faculty and students that share a desire to understand the partnership between humans and technology that arises as...
Vision-Based Recognition of Actions using Context (2000)
Irfan A. Essa, Mark A. Clements, Gwendolyn W, Darnell Janssen Moore
In this dissertation, we address the problem of recognizing human interactions with objects from video. Methods for recognizing these activities using human motion and information about objects are...
Gregory D. Abowd, Christopher G. Atkeson, Aaron F. Bobick, Irfan A. Essa, Blair Macintyre Elizabeth
The Future Computing Environments (FCE) Group at Georgia Tech is a collection of faculty and students that share a desire to understand the partnership between humans and technology that arises as...
Machine Learning for Video-Based Rendering (2000)
We recently introduced a new paradigm for computer animation, video textures, which allows us to use a recorded video to generate novel animations by replaying the video samples in a new order. Video...
Xu, Jun, Essa, Irfan A., Lipton, Richard J.
In this paper, we propose the concept of a humanizer and explore its applications in network security and E-commerce. A humanizer is a novel authentication scheme that asks the question "are you...
Exploiting Human Actions and Object Context for Recognition Tasks (1999)
Moore, Darnell Janssen, Essa, Irfan A., Hayes, M. H. (Monson H.)
Our goal is to exploit human motion and object context to perform action recognition and object classification. Towards this end, we introduce a framework for recognizing actions and objects by...
Robust Tracking of People by a Mobile Robotic Agent (1999)
Tanawongsuwan, Rawesak, Stoytchev, Alexander, Essa, Irfan A.
We present methods for tracking people in dynamic and changing environments from camera mounted on a mobile robot. We describe processes to extract color, motion, and depth information from video and...
Motion Based Decompositing of Video (1999)
Brostow, Gabriel Julian, Essa, Irfan A.
We present a method to decompose video sequences into layers that represent the relative depths of complex scenes. Our method combines spatial information with temporal occlusions to determine...
Detecting and Tracking Eyes by Using their Physiological Properties, Dynamics and Appearance (1999)
Haro, Antonio, Flickner, Myron, Essa, Irfan A.
Reliable detection and tracking of eyes is an important requirement for attentive user interfaces. In this paper, we present a methodology for detecting eyes robustly in indoor environments in...
Computers Seeing People (1999)
One of the most exciting and challenging research quests of the last thirty years has been the building of machines that can see. Much effort has been expended on "automatic deduction of...
Exploiting Human Actions and Object Context for Recognition Tasks (1999)
Moore, Darnell Janssen, Essa, Irfan A., Hayes, M. H. (Monson H.)
Our goal is to exploit human motion and object context to perform action recognition and object classification. Towards this end, we introduce a framework for recognizing actions and objects by...
Robust Tracking of People by a Mobile Robotic Agent (1999)
Tanawongsuwan, Rawesak, Stoytchev, Alexander, Essa, Irfan A.
We present methods for tracking people in dynamic and changing environments from camera mounted on a mobile robot. We describe processes to extract color, motion, and depth information from video and...
Motion Based Decompositing of Video (1999)
Brostow, Gabriel Julian, Essa, Irfan A.
We present a method to decompose video sequences into layers that represent the relative depths of complex scenes. Our method combines spatial information with temporal occlusions to determine...
Detecting and Tracking Eyes by Using their Physiological Properties, Dynamics and Appearance (1999)
Haro, Antonio, Flickner, Myron, Essa, Irfan A.
Reliable detection and tracking of eyes is an important requirement for attentive user interfaces. In this paper, we present a methodology for detecting eyes robustly in indoor environments in...
Coding, Analysis, Interpretation, and Recognition of Facial Expressions (1998)
We describe a computer vision system for observing facial motion by using an optimal estimation optical flow method coupled with geometric, physical and motion-based dynamic models describing the...
Head Tracking using a Textured Polygonal Model (1998)
Schodl, Arno, Haro, Antonio, Essa, Irfan A.
We describe the use of a three-dimensional textured model of the human head under perspective projection to track a person's face. The system is hand-initialized by projecting an image of a face onto...
A System for Tracking and Recognizing Multiple People with Multiple Camera (1998)
Stillman, Scott T., Tanawongsuwan, Rawesak, Essa, Irfan A.
In this paper we present a robust real-time method for tracking and recognizing multiple people with multiple cameras. Our method uses both static and Pan-Tilt-Zoom (PTZ) cameras to provide visual...
Object Spaces: Context Management for Human Activity Recognition (1998)
Moore, Darnell Janssen, Essa, Irfan A., Hayes, M. H. (Monson H.)
In this paper, we propose a vision-based method for developing computer awareness of human activities. We present an object-oriented approach called ObjectSpaces that encapsulates context into scene...
Head Tracking Using a Textured Polygonal Model (1998)
Arno Schödl, Antonio Haro, Irfan A. Essa
We describe the use of a three-dimensional textured model of the human head under perspective projection to track a person's face. The system is hand-initialized by projecting an image of the...
Coding, Analysis, Interpretation, and Recognition of Facial Expressions (1998)
We describe a computer vision system for observing facial motion by using an optimal estimation optical flow method coupled with geometric, physical and motion-based dynamic models describing the...
Coding, Analysis, Interpretation, and Recognition of Facial Expressions (1998)
We describe a computer vision system for observing facial motion by using an optimal estimation optical flow method coupled with geometric, physical and motion-based dynamic models describing the...
Head Tracking using a Textured Polygonal Model (1998)
Schodl, Arno, Haro, Antonio, Essa, Irfan A.
We describe the use of a three-dimensional textured model of the human head under perspective projection to track a person's face. The system is hand-initialized by projecting an image of a face onto...
A System for Tracking and Recognizing Multiple People with Multiple Camera (1998)
Stillman, Scott T., Tanawongsuwan, Rawesak, Essa, Irfan A.
In this paper we present a robust real-time method for tracking and recognizing multiple people with multiple cameras. Our method uses both static and Pan-Tilt-Zoom (PTZ) cameras to provide visual...
Object Spaces: Context Management for Human Activity Recognition (1998)
Moore, Darnell Janssen, Essa, Irfan A., Hayes, M. H. (Monson H.)
In this paper, we propose a vision-based method for developing computer awareness of human activities. We present an object-oriented approach called ObjectSpaces that encapsulates context into scene...
Task-specific Gesture Analysis in Real-Time using Interpolated Views (1996)
Trevor Darrell, Irfan A. Essa, Alex P. Pentl
Hand and face gestures are modeled using an appearance-based approach in which patterns are represented as a vector of similarity scores to a set of view models defined in space and time. These view...
Analysis, interpretation and synthesis of facial expressions (1995)
Thesis (Ph. D.)--Massachusetts Institute of Technology, Program in Media Arts & Sciences, 1995.
Analysis, interpretation and synthesis of facial expressions (1995)
Thesis (Ph. D.)--Massachusetts Institute of Technology, Program in Media Arts & Sciences, 1995.
Coding, Analysis, Interpretation, and Recognition of Facial Expressions (1995)
Irfan A. Essa, Alex P. Pentland
We describe a computer vision system for observing facial motion by using an optimal estimation optical flow method coupled with a geometric and a physical (muscle) model describing the facial...
Irfan A. Essa, Trevor Darrell, Alex Pentland
We describe a computer system that allows real-time tracking of facial expressions. Sparse, fast visual measurements using 2-D templates are used to observe the face of a subject. Rather than track...
A Vision System for Observing and Extracting Facial Action Parameters (1994)
We describe a computer vision system for observing the "action units" of a face using video sequences as input. The visual observation (sensing) is achieved by using an optimal estimation...
Contact detection, collision forces and friction for physically based virtual world modeling (1990)
Thesis (M.S.)--Massachusetts Institute of Technology, Dept. of Civil Engineering, 1990.
Supervised by Alex Pentland.
Contact detection, collision forces and friction for physically based virtual world modeling (1990)
Thesis (M.S.)--Massachusetts Institute of Technology, Dept. of Civil Engineering, 1990.