Publications-ppc
A Deep-Learning Based Framework for Source Separation, Analysis, and Synthesis of Choral Ensembles
Authors
Chandna P, Cuesta H, Petermann D, Gómez E
UPF authors
Type
Scholarly articles
Journal title
Frontiers
Publication year
2022
Volume
2
Pages
1-15
ISSN
0160-9009
Publication State
Published
Abstract
Choral singing in the soprano, alto, tenor and bass (SATB) format is a widely practiced and studied art form with significant cultural importance. Despite the popularity of the choral setting, it has received little attention in the field of Music Information Retrieval. However, the recent publication of high-quality choral singing datasets as well as recent developments in deep learning based methodologies applied to the field of music and speech processing, have opened new avenues for research in this field. In this paper, we use some of the publicly available choral singing datasets to train and evaluate state-ofthe-art source separation algorithms from the speech and music domains for the case of choral singing. Furthermore, we evaluate existing monophonic F0 estimators on the separated unison stems and propose an approximation of the perceived F0 of a unison signal. Additionally, we present a set of applications combining the proposed methodologies, including synthesizing a single singer voice from the unison, and transposing and remixing the separated stems into a synthetic multi-singer choral signal. We finally conduct a set of listening tests to perform a perceptual evaluation of the results we obtain with the proposed methodologies.
Complete citation
Chandna P, Cuesta H, Petermann D, Gómez E. A Deep-Learning Based Framework for Source Separation, Analysis, and Synthesis of Choral Ensembles. Frontiers 2022; 2( ): 1-15.
CiteScore
0.3 (2015)
Scopus Sources
Index Scimago: 0.148 (2019)
HSJR index
19.0 (2020)
SJR quartile
Q3 (2018)
SJR area
Arts and Humanities (miscellaneous) (Q3); Gender Studies (Q4) (2018)
Evaluation: B
Scope: GENERAL O MULTIDISCIPLINAR