Laser Microbeam and Medical Program    »     People  |   Education & Dissemination  |   Research & Resources  |   Publications
LAMMP Seminar Video
Capturing and analyzing human gestures: toward novel computer-based music systems
Frédéric Bevilacqua, PhD

I will present an overview of the research performed by the Real-Time Musical Interactions Team of IRCAM (Paris). For the last seven years, we have developed various methods and tools to measure and analyze human gestures, with the general goal of using body movements to interact with sonic and/or visual digital media. This research has largely been influenced by sustained collaborations with musicians/composers and dancers/choreographers. In particular, we studied musician gestures such as the bow motion of violin players. This allowed us to formalize key concepts about continuous gesture control, gesture segmentation and co-articulation (similarly to speech production). This research led us to design a real-time gesture analysis system (called the "gesture follower") that allows for the recognition and synchronization of gestures with various sound synthesis systems. I will also describe concrete applications concerning the design of "augmented" musical instruments, new music computer interfaces and music games. About the Speaker Frédéric Bevilacqua is the head of the Real Time Musical Interactions team at IRCAM - Institute for Music/AcousticResearch and Coordination in Paris. He holds a master degree in physics (1991) and a Ph.D. in Biomedical Optics (1998) from the Ecole Polytechnique Fédérale de Lausanne (Swiss Federal Institute of Technolgy in Lausanne). He also studied music at the Berklee College of Music in Boston (1992–1993) and has participated in different music and media arts projects. From 1999 to 2003 he conducted various research projects at the Beckman Laser Institute at the University of California Irvine. He joined IRCAM in October 2003 as researcher on gesture analysis for music and performing arts.

LAMMP Seminars

View selected seminars online

Supported by


P41EB015890