Developing Methods and Tools for Studying Body Actions and Musical Sound
Alexander Refsum Jensenius, Department of Musicology, University of Oslo
The presentation will focus on two challenges encountered in the study of music-related body actions: description and visualization.
Description: A number of different hardware and software tools are used in musical gestures research, e.g. motion capture, computer vision and sensor based systems. Several problems arise due to lack of standards and inadequate representation forms for such data and media. This makes it difficult to classify, store, share and compare the information. We have started developing GDIF (Gesture Description Interchange Format), based on SDIF, to allow for storing music related motion data in a standardized way. While other gesture format initiatives tend to focus on low-level features, we are more interested in storing mid- and high-level features.
Visualization: I will present the idea of \"motiongrams\" and how these are used for navigation and comparative studies of video.