Developing Physically-Based, Dynamic Vocal Tract Models using ArtiSynth (2008)
Sidney Fels, John E. Lloyd, Florian Vogt, Ian Stavness, Eric Vatikiotis-bateson
Abstract. We describe the process of using ArtiSynth, a 3D biomechanical simulation platform, to build models of the vocal tract and upper airway which are capable of simulating speech sounds....
A QWERTY FOR THE MUSICIAN (2008)
Farhan Mohamed, Lorna Slater, Sidney Fels
Software based music sequencing is a tool used by modern electronic musicians for composing. The existing user interfaces for composing and sequencing electronic music are awkward because they...
An Evaluation of a Vibro-Tactile Display Prototype for Physiological Monitoring (2008)
Joc. F. Man, Sidney Fels, Guy Dumont, J. Mark Ansermino
Visual displays and auditory alarms are used to convey information on physiological variables in an operating room. However, the exponential growth in the number of physiological variables and the...
A Linear Programming Approach for Multiple Object Tracking (2008)
Hao Jiang, Sidney Fels, James J. Little
We propose a linear programming relaxation scheme for the class of multiple object tracking problems where the inter-object interaction metric is convex and the intraobject term quantifying object...
EECE 496 Project Final Report Mixing Shadows into Video Imagery (2008)
Student Benson Huang, Supervisor Dr, Sidney Fels, Changsong Shen
Yuichiro Kinoshita, Yasufumi Takama, Sidney Fels, Kenji Funahashi, Ashley Gadd
As a locomotion interface for virtual reality, swimming afloat in water, is an unfamiliar and intriguing paradigm. We propose to bring our virtual swimming apparatus to SIG-GRAPH 2004 Emerging...
Experiences with a Virtual Swimming Interface Exhibit (2008)
Sidney Fels, Steve Yohanan, Sachiyo Takahashi, Yuichiro Kinoshita, Kenji Funahashi
We created an exhibit based on a new locomotion interface for swimming in a virtual reality ocean environment as part of our Swimming Across the Pacific art project. In our exhibit we suspend the...
Developing Physically-Based, Dynamic Vocal Tract Models using ArtiSynth (2008)
Sidney Fels, John E. Lloyd, Florian Vogt, Ian Stavness, Eric Vatikiotis-bateson
Abstract. We describe the process of using ArtiSynth, a 3D biomechanical simulation platform, to build models of the vocal tract and upper airway which are capable of simulating speech sounds....
Meghan Deutscher, Reynald Hoskinson, Sachiyo Takashashi, Sidney Fels
We present a novel way of manipulating a spatial soundscape, one that encourages collaboration and exploration. Through a table-top display surrounded by speakers and lights, participants are invited...
Meghan Deutscher, Sidney Fels, Reynald Hoskinson, Sachiyo Takahashi
The playful, graceful motions of Beluga whales swimming in water create a mesmerizing motion space to watch. These highly communicative creatures use a variety of vocalization, physical expressions...
User Experiences with a Virtual Swimming Interface Exhibit (2008)
Sidney Fels, Steve Yohanan, Sachiyo Takahashi, Yuichiro Kinoshita, Yasufumi Takama
Abstract. We created an exhibit based on a new locomotion interface for swimming in a virtual reality ocean environment as part of our Swimming Across the Pacific art project. In our exhibit we...
Hierarchical Agent Interface for Controlling and Animating Agents (2007)
Sidney Fels, Armin Bruderlin, Silvio Esser, Kenji Mase
Asynchronous, Hierarchical Agents (AHAs) provide a vertically structured multilevel abstraction hierarchy. In this paper, we argue that this multilevel hierarchy is a convenient way to create a...
KEYed user interface: Tools for expressive music production (2007)
We introduce the KEYed user interface, an ergonomic and intuitive method for controlling music composition software from a piano controller by adding a momentary foot switch. The piano keyboard...
Responses in Light, Sound and Scent — (2007)
Sidney Fels, A Therapeutic, Interactive Yoga System
We describe an interactive system that uses gesture recognition to enhance the yoga experience through visual, auditory and olfactory feedback. Ancient theories associated with Kundalini yoga provide...
Sidney Fels, Kazushi Nishimoto, Kenji Mase
This paper introduces a new multi-media system for musical and graphical expression called MusiKalscope. Inside of MusiKalscope are two sub-systems: RhyMe and the Iamascope, connected by a third...
MetaMuse: Metaphors for Expressive Instruments (2007)
We explore the role that metaphor plays in developing expressive devices by examining the MetaMuse system. Meta-Muse is a prop-based system that uses the metaphor of rainfall to make the process of...
ABSTRACT Interactive Video Cubism (2007)
This paper presents an interactive video visualization system. In this visualization video data is considered to be a block of three dimensional data where frames of video data comprise the third...
MetaMuse: Metaphors for Expressive Instruments (2007)
We explore the role that metaphor plays in developing expressive devices by examining the MetaMuse system. Meta-Muse is a prop-based system that uses the metaphor of rainfall to make the process of...
Ivan Poupyrev, Michael J. Lyons, Sidney Fels, Tina Blaine (bean
Topic: The impact of interface technology on all aspects of musical expression. The rapid evolution of electronics, digital media, advanced materials, and other areas of technology, is opening up...
IN SUBMISSION: PREPRINT ONLY Evolving Tooka: from Experiment to Instrument (2007)
The Tooka was created as an exploration of two person instruments. We have worked with two Tooka performers to enhance the original experimental device to make a musical instrument played and enjoyed...
A multi-camera surveillance system that estimates quality-of-view measurement (2007)
Changsong Shen, Chris Zhang, Sidney Fels
In this paper, we propose a multi-camera video surveillance system with automatic camera selection. A new confidence measure, Quality-Of-View (QOV), is defined to automatically evaluate the...
An Efficient Biomechanical Tongue model for Speech Research. (2006)
Vogt, Florian, Lloyd, John, Buchaillard, Stéphanie, Perrier, Pascal, Chabanas, Matthieu, Payan, Yohan, ...
This paper describes our investigation of a fast 3D finite element method (FEM) for biomedical simulation of a muscle-activated human tongue. Our method uses a linear stiffness-warping scheme to...
Efficient 3D Finite Element Modeling of a Muscle-Activated Tongue (2006)
Vogt, Florian, Lloyd, John, Buchaillard, Stéphanie, Perrier, Pascal, Chabanas, Matthieu, Payan, Yohan, ...
We describe our investigation of a fast 3D finite element method (FEM) for biomedical simulation of a muscle-activated human tongue. Our method uses a linear stiffness-warping scheme to achieve...
An integrated, dynamic jaw and laryngeal model constructed from ct data (2006)
Ian Stavness, Alan G. Hannam, John E. Lloyd, Sidney Fels
Abstract. Computational modeling is an important tool for studying the structure and function of human anatomy in biomedicine. In this paper, a dynamic, anatomically accurate model of the human...
Towards articulatory speech synthesis with a dynamic 3D finite element tongue model (2006)
Florian Vogt, R. Elliot English, Sidney Fels
Abstract. We describe work towards articulatory speech synthesis driven by realistic 3D tissue and bone models. The vocal tract shape is modeled using a fast 3D finite element method (FEM) of a...
Towards articulatory speech synthesis with a dynamic 3D finite element tongue model (2006)
Florian Vogt, R. Elliot English, Sidney Fels
Abstract. We describe work towards articulatory speech synthesis driven by realistic 3D tissue and bone models. The vocal tract shape is modeled using a fast 3D finite element method (FEM) of a...
Meghan Deutscher, Sidney Fels, Reynald Hoskinson, Sachiyo Takahashi
INTRODUCTION The playful, graceful motions of Beluga whales swimming in water create a mesmerizing motion space to watch. These highly communicative creatures use a variety of vocalization, physical...
Ian Stavness, Jennifer Gluck, Leah Vilhan, Sidney Fels
Abstract. Popular acceptance of the mp3 digital music standard has greatly increased the complexity of organizing and playing large music collections. Existing digital music systems do not adequately...
Ian Stavness, Jennifer Gluck, Leah Vilhan, Sidney Fels
Abstract. Popular acceptance of the mp3 digital music standard has greatly increased the complexity of organizing and playing large music collections. Existing digital music systems do not adequately...
Manipulating music: multimodal interaction for DJs (2004)
Timothy Beamish, Karon Maclean, Sidney Fels
In this paper we consider the general goal of supporting physical manipulation of digital audio in a specific context: the performance disk jockey (DJ) seeking to migrate from vinyl to digital media....
RemoteEyes: A Remote Low-Cost Position Sensing Infrastructure for (2004)
Ubiquitous Computing Changsong, Changsong Shen, Baosheng Wang, Florian Vogt, Steve Oldridge, Sidney Fels
This paper describes the architecture of a remote low-cost position sensing infrastructure for ubiquitous computing. To reduce the cost, each tracked object carries an inexpensive active tag that...
Manipulating music: multimodal interaction for DJs (2004)
Timothy Beamish, Karon Maclean, Sidney Fels
In this paper we consider the general goal of supporting physical manipulation of digital audio in a specific context: the performance disk jockey (DJ) seeking to migrate from vinyl to digital media....
Remoteeyes: A remote low-cost position sensing infrastructure for ubiquitous computing (2004)
Changsong Shen, Baosheng Wang, Florian Vogt, Steve Oldridge, Sidney Fels
This paper describes the architecture of a remote low-cost position sensing infrastructure for ubiquitous computing. To reduce the cost, each tracked object carries an inexpensive active tag that...
D’Groove: A Haptic Turntable for Digital Audio Control (2003)
Timothy Beamish, Karon Maclean, Sidney Fels
In this paper, we discuss the design and implementation of D’Groove, an intelligent Disc Jockey (DJ) system that uses a haptic turntable for controlling the playback of digital audio. We begin by...
The NS Simulator, "http://www.isi.edu/nsnam/ns (2003)
In this paper, we discuss a new hand-gesture-based application, FlowField, which explores the use of pressure-sensitive multipoint touchpad (multi-touch) interaction. FlowField allows participants to...
Interacting with the big screen: pointers to ponder (2002)
Duncan Cavens, Florian Vogt, Sidney Fels, Michael Meitner
In large screen projection environments, inexpensive wireless input devices can not match the performance of standard desktop interactive devices. We added buttons and a radio transmitter to a...
LMNKui: Overlaying computer controls on a piano controller keyboard (2002)
We introduce the Look Ma No Keyboard user interface, an ergonomic and intuitive method for controlling a music sequencing software from the piano controller by adding a momentary foot switch. After...
FlowField: Investigating the Semantics of Caress (2002)
We have created a new interactive experience piece called Flow-Field. Participants touch and caress a multi-point touchpad, the MTC Express, in a CAVE (CAVE Automatic Virtual Environment), directly...
Florian Vogt, Graeme Mccaig, Mir Adnan Ali, Sidney Fels
Here we propose a novel musical controller which acquires imaging data of the tongue with a two-dimensional medical ultrasound scanner. A computer vision algorithm extracts from the image a discrete...
Tongue ‘n’ Groove: An Ultrasound based Music Controller (2002)
Florian Vogt, Graeme Mccaig, Mir Adnan Ali, Sidney Fels
Here we propose a novel musical controller which acquires imaging data of the tongue with a two-dimensional medical ultrasound scanner. A computer vision algorithm extracts from the image a discrete...
Mapping transparency through metaphor: towards more expressive musical instruments (2002)
Sidney Fels, Ashley Gadd, Axel Mulder
We define a two-axis transparency framework that can be used as a predictor of the expressivity of a musical device. One axis is the player's transparency scale, while the other is the...
LMNKui: Overlaying computer controls on a piano controller keyboard (2002)
We introduce the Look Ma No Keyboard user interface, an ergonomic and intuitive method for controlling music sequencing software from a piano controller by adding a momentary foot switch. After...
Interactive Genetically Generated Music Composing with a Genetic Algorithm (2001)
This report investigates the use of genetic algorithms to compose music and examines various additions to an existing system in order to improve the richness and expression of the system’s...
Evolutionary Textured Sound Composition (2001)
Abstract. We describe a system that maps the interaction between two people to control a genetic process for generating music. We start with a population of melodies encoded genetically. This...
Interactive video cubism (2000)
This paper presents an interactive video visualization technique called video cubism. With this technique, video data is considered to be a block of three dimensional data where frames of video data...
Iamascope: A graphical musical instrument (1999)
The Iamascope is an interactive, electronic kaleidoscope. The Iamascope combines computer video, graphics, vision, and audio technology for performers to create striking imagery and sound with this...
Iamascope: A Graphical Musical Instrument (1999)
The Iamascope is an interactive, electronic kaleidoscope. The Iamascope combines computer video, graphics, vision, and audio technology for performers to create striking imagery and sound with this...
InvenTcl: A fast prototyping environment for 3D graphics and multimedia applications (1998)
Abstract. This paper describes InvenTcl which isaninterpretive version of Open Inventor, a 3D graphics toolkit. To create InvenTcl, the Open Inventor toolkit is \wrapped " inside the...
Progress of C-Map: a Context-Aware Mobile Assistant (1998)
Sidney Fels, Yasuyuki Sumi, Tameyuki Etani, Nicolas Simonet, Kaoru Kobayashi, Kenji Mase
An interface agent with a life-like character on a personal mobile computer based guidance system is a plausible interface design approach for supporting and mediating communication between...
Progress of C-Map: a Context-Aware Mobile Assistant (1998)
Sidney Fels, Yasuyuki Sumi, Tameyuki Etani, Nicolas Simonet, Kaoru Kobayashi, Kenji Mase
An interface agent with a life-like character on a personal mobile computer based guidance system is a plausible interface design approach for supporting and mediating communication between...
InvenTcl: A Fast Prototyping Environment for 3D Graphics and Multimedia Applications (1998)
. This paper describes InvenTcl which is an interpretive version of Open Inventor, a 3D graphics toolkit. To create InvenTcl, the Open Inventor toolkit is "wrapped" inside the interpreter...
Asynchronous Hierarchical Architecture for Controlling and Animating Interface Agents (1998)
Kenji Mase, Sidney Fels, Armin Bruderlin, Yasuyuki Sumi, Rieko Kadobayashi
An interface agent with a life-like character on a personal and mobile computer based guidance system is a plausible interface design approach for supporting and mediating communication between the...
Glove-TalkII: An Adaptive Gesture-to-Formant Interface (1998)
Glove-TalkII is a system which translates hand gestures to speech through an adaptive interface. Hand gestures are mapped continuously to 10 control parameters of a parallel formant speech...
Iamascope: A Musical Application for Image Processing (1998)
The Iamascope is an interactive, electronic kaleidoscope. The Iamascope combines computer video, graphics, vision, and audio technology for performers to create striking imagery and sound with this...
Progress of C-MAP: a Context-aware Mobile Assistant (1998)
Sidney Fels, Yasuyuki Sumi, Tameyuki Etani, Nicolas Simonet, Kaoru Kobayashi, Kenji Mase
An interface agent with a life-like character on a personal mobile computer based guidance system is a plausible interface design approach for supporting and mediating communication between...
Hierarchical Agent Interface for Animation (1997)
Armin Bruderlin, Sidney Fels, Silvio Esser, Kenji Mase
Asynchronous, Hierarchical Agents (AHAs) provide a vertically structured multilevel abstraction hierarchy.In this paper, we argue that this multilevel hierarchyisa convenientway to create a...
Inventcl: Making open inventor interpretive with tcl/[incr tcl (1997)
Sidney Fels, Silvio Esser, Armin Bruderlin, Kenji Mase
Open Inventor is an object oriented 3D graphics toolkit written in C++. Because Open In-ventor is written in C++, typical user code development consists of a program/compile/debug iteration cycle. In...
MusiKalscope: A Graphical Musical Instrument (1997)
Sidney Fels, Kazushi Nishimoto, Kenji Mase
This paper introduces a new multi-media system for musical and graphical expression called MusiKalscope. Inside of MusiKalscope are two sub-systems: RhyMe and the Iamascope, connected by a third...
InvenTcl: Making Open Inventor Interpretive with Tcl/[incr Tcl] (1997)
Sidney Fels, Silvio Esser, Armin Bruderlin, Kenji Mase, Socube ?root?separator?mycube
ng code shows how a simple scene graph is created interpretively: SoSeparator ?root?separator1 SoMaterial ?root?separator1?material1 SoCube ? ?root?separator1?myCube This series of commands adds an...
MusiKalscope: A Graphical Musical Instrument (1997)
Sidney Fels, Kazushi Nishimoto, Kenji Mase
This paper introduces a new multi-media system for musical and graphical expression called MusiKalscope. Inside of MusiKalscope are two sub-systems: RhyMe and the Iamascope, connected by a third...
Iamascope: An Interactive Kaleidoscope (1997)
Sidney Fels, Dirk Reiners, Kenji Mase
a colourful piece of floating glass inside the kaleidoscope, and simultaneously views a kaleidescopic image of himself on a huge screen (170") in real time. The body movements of the participant...
Hierarchical Agent Interface for Animation (1997)
Armin Bruderlin, Sidney Fels, Silvio Esser, Kenji Mase
Asynchronous, Hierarchical Agents (AHAs) provide a vertically structured multilevel abstraction hierarchy. In this paper, we argue that this multilevel hierarchy is a convenient way to create a...
Hierarchical AgentInterface for Animation (1997)
Armin Bruderlin And, Armin Bruderlin, Sidney Fels, Silvio Esser, Kenji Mase
Asynchronous, Hierarchical Agents (AHAs) provide a vertically structured multilevel abstraction hierarchy.In this paper, we argue that this multilevel hierarchyisa convenientway to create a...
Agent 99: Implementing a simple card game using agents (1996)
Sidney Fels, Kenji Mase, Tameyuki Etani, Armin Bruderlin, Silvio Esser
This paper describes progress in defining a computer agent architecture to provide a conceptual framework for agent development. In our nomenclature, agent refers to an autonomous computer program...
Artisynth: A biomechanical simulation platform for the vocal tract and upper airway (1986)
Sidney Fels, Florian Vogt, John E. Lloyd, Ian Stavness, Eric Vatikiotis-bateson
platform directed toward modeling the vocal tract and upper airway. It provides an open-source environment in which researchers can create and interconnect various kinds of dynamic and parametric...