Natural Language Processing for Music Information Retrieval

 

An increasing amount of musical information is being published daily in media like Social Networks, Digital Libraries or Web Pages. All this data has the potential to impact in musicological studies, as well as tasks within MIR such as music recommendation. Making sense of it is a very challenging task, and so this tutorial aims to provide the audience with potential applications of Natural Language Processing (NLP) to MIR and Computational Musicology.

In this tutorial, we will focus on linguistic, semantic and statistical-­based approaches to extract and formalize knowledge about music from naturally occurring text. We propose to provide the audience with a preliminary introduction to NLP, covering its main tasks along with the state­-of-­the-­art and most recent developments. In addition, we will showcase the main challenges that the music domain poses to the different NLP tasks, and the already developed methodologies for leveraging them in MIR and musicological applications.

We will also introduce some of the most popular python libraries for NLP (e.g. Gensim, Spacy) and useful lexical resources (e.g. WordNet, BabelNet). At the same time, the tutorial analyzes the challenges and opportunities that the application of these techniques to large amounts of texts presents to MIR researchers and musicologists, presents some research contributions and provides a forum to discuss about how address those challenges in future research. We envisage this tutorial as a highly interactive session, with a sizable amount of hands­-on activities and live demos of actual systems.

This tutorial has two versions, one given at ISMIR 2016, and a more recent one, given at the Universitat Pompeu Fabra in 2017.

 

UPF 2017 Tutorial

Topics covered in the tutorial:
  • Basic text preprocessing and normalization
  • Linguistic enrichment in the form of part-­of-­speech tagging, as well as shallow and 
dependency parsing.
  • Information Extraction, with special focus on Entity Linking and Relation Extraction.
  • Sentiment Analysis
  • Lexical Semantics (word embeddings)
  • Deep Learning
  • Applications in MIR
  • Applications in Musicology

Tutorial presenters

Sergio Oramas received a degree in Computer Engineering by the Technical University of Madrid in 2004, and a B.A. in Musicology by the University of La Rioja in 2011. He is a PhD candidate at the Music Technology Group (Pompeu Fabra University) since 2013, holding a “La Caixa” PhD Fellowship. His research interests are focused on the extraction of structured knowledge from text and its application in Music Information Retrieval and Computational Musicology.

Luis Espinosa­-Anke is a PhD candidate at the Natural Language Processing group in at Pompeu Fabra University. His research focuses in learning knowledge representations of language, including automatic construction of glossaries; knowledge base generation, population and unification; and automatic taxonomy learning. He is Fulbright alumni, “laCaixa” scholar, and member of the Erasmus Mundus Association as well as the European Network of eLexicography.

 

Tutorial Material

 

ISMIR 2016 Tutorial

Topics covered in this tutorial:

 

  • Basic text preprocessing and normalization
  • Linguistic enrichment in the form of part-­of-­speech tagging, as well as shallow and 
dependency parsing.
  • Information Extraction, with special focus on Entity Linking and Relation Extraction.
  • Text Mining
  • Topic Modeling
  • Sentiment Analysis
  • Word Vector Embeddings

Tutorial presenters

Sergio Oramas received a degree in Computer Engineering by the Technical University of Madrid in 2004, and a B.A. in Musicology by the University of La Rioja in 2011. He is a PhD candidate at the Music Technology Group (Pompeu Fabra University) since 2013, holding a “La Caixa” PhD Fellowship. His research interests are focused on the extraction of structured knowledge from text and its application in Music Information Retrieval and Computational Musicology.

Luis Espinosa­-Anke is a PhD candidate at the Natural Language Processing group in at Pompeu Fabra University. His research focuses in learning knowledge representations of language, including automatic construction of glossaries; knowledge base generation, population and unification; and automatic taxonomy learning. He is Fulbright alumni, “laCaixa” scholar, and member of the Erasmus Mundus Association as well as the European Network of eLexicography.

Shuo Zhang is a PhD candidate in Computational Linguistics at Georgetown University, USA, and a collaborator/researcher at the Music Technology Group, Universitat Pompeu Fabra. He has worked in both text (NLP­information extraction) and sound (speech processing­time­series data mining in speech prosody) aspects of computational linguistics and their applications in MIR. His past and current projects include areas such as coreference resolution, search and visualization of multilayered linguistic corpora, text mining & topic modeling in MIR, temporal semantics, time­series mining in speech and music, etc. Shuo holds B.Sci. from the Peking University, M.A. from the Department of Music, University of Pittsburgh, and M.Sci. in Computational Linguistics from Georgetown University.

Tutorial Material

References

Sergio Oramas, Luies Espinosa-Anke, Shuo Zhang, Horacio Saggion & Xavier Serra (2016). Natural Language Processing for Music Information Retrieval. 17th International Society for Music Information Retrieval