Dalmazzo D, Ramirez R. Bowing Gestures Classification in Violin Performance: A Machine Learning Approach. Frontiers in Psychology
We develop a large number of software tools and hosting infrastructures to support the research developed at the Department. We will be detailing in this section the different tools available. You can take a look for the moment at the offer available within the UPF Knowledge Portal, the innovations created in the context of EU projects in the Innovation Radar and the software sections of some of our research groups:
|
Artificial Intelligence |
Nonlinear Time Series Analysis |
Web Research |
Music Technology |
|
Interactive Technologies |
Barcelona MedTech |
Natural Language Processing |
Nonlinear Time Series Analysis |
|
UbicaLab |
Wireless Networking |
Educational Technologies |
Dalmazzo D, Ramirez R. Bowing Gestures Classification in Violin Performance: A Machine Learning Approach. Frontiers in Psychology
Dalmazzo D, Ramirez R. Bowing Gestures Classification in Violin Performance: A Machine Learning Approach. Frontiers in Psychology
Gestures in music are of paramount importance partly because they are directly linked to musicians' sound and expressiveness. At the same time, current motion capture technologies are capable of detecting body motion/gestures details very accurately.
We present a machine learning approach to automatic violin bow gesture classification based on Hierarchical Hidden Markov Models (HHMM) and motion data. We recorded motion and audio data corresponding to seven representative bow techniques (Détaché, Martelé, Spiccato, Ricochet, Sautillé, Staccato and Bariolage) performed by a professional violin player. We used the commercial Myo device for recording inertial motion information from the right forearm and synchronized it with audio recordings. Data was uploaded into an online public repository.
After extracting features from both the motion and audio data, we trained an HHMM to identify the different bowing techniques automatically. Our model can determine the studied bowing techniques with over 94% accuracy. The results make feasible the application of this work in a practical learning scenario, where violin students can benefit from the real-time feedback provided by the system.
DOI: doi: 10.3389/fpsyg.2019.00344
Additional material:
The datasets [GENERATED/ANALYZED] for this study can be found in
https://github.com/Dazzid/DataToRepovizz/tree/myo_ to_repovizz/myo_recordings