Research projects
 |
Exploring Creative Expression through Music and Audio Technology The basic process of music recording and production has remained the same for the past 40 years. This research project makes use of structured audio, a novel format that can take full advantage of the capabilities of digital music devices and offers the opportunity to dramatically improve the music production and listening experience. |
 |
MoodSwings: A collaborative game for music mood labeling MoodSwings is a collaborative "game with a purpose", designed to enable the collection of continuous mood ratings of musical excerpts through a fun and engaging activity. You play with others across the internet with the goal of agreeing on current mood of a song within a grid defined by valence (happy vs. sad) and intensity (energetic vs. calm). The more you and your partner agree, the more points you receive! |
 |
Online Activities for Learning and Listening Web-based, cross platform games designed to illustrate pscyhoacoustic concepts to K-12 students and collect human evaluation data. These games introduce players to problems in speaker identification and musical timbre recognition through interactive interfaces that encourage learning through experimentation. |
 |
Dancing Robots: Exploring Dance Creativity We have programmed a RoboNova robot to dance to the beat of audio. This will allow us to program more complex robots to do the same, and eventually study dance creativity. |
 |
This research project develops and implements a one-year longitudinal evaluation of the impact of musical video games that specifically investigates: how game proficiency impacts musical skill development, and how avid game play leads to the pursuit of other music making outlets and formal music education. This one-year research project is supported by grant from the NAMM Foundation . |
 |
This project uses a multi-touch display to allow a more intuitive interaction between a human and a computer . |
 |
Gesture Recognition for Conducting Computer Music Researching the enabling of computers to identify and respond to gestures. Success will open up a broad new communications channel for manipulating electronics and digital audio. |
 |
Real-time Audio-to-Score Alignment (a.k.a. Score Following) This research develops an algorithm that a computer would use to keep track of the progress of a live performance in reference to a musical score or a previous recording of the same composition. |
 |
Joint Voice Identification and Separation This research explores the performance of an automatic speaker identification system using the voice as a biometric identifier. This project is a collaboration with Dr. John MacLaren Walsh. |
 |
Adaptive Physical Interfaces for Digital Music Using digital sampling and/or synthesis, an infinite number of sounds can be created. In order to play and control these sounds musically, the must be a physical interface that one "plays." This project will research the newest digital tools for digital sound control, develop new applications for traditional instrument forms, and design adaptive physical interfaces that are more flexible than those based on conventional instruments. |