Essentia.js: a JavaScript library for music and audio analysis on the web

  • Authors
  • Correya A, Bogdanov D, Jjoglar-Ongay L, Serra X
  • UPF authors
  • SERRA, XAVIER; BOGDANOV, DMITRY; CORREYA ., ALBIN ANDREW;
  • Authors of the book
  • Laplante A, Fujinaga I
  • Book title
  • Proceedings of the 21st International Society for Music Information Retrieval Conference (ISMIR)
  • Publisher
  • International Society for Music Information Retrieval (ISMIR)
  • Publication year
  • 2020
  • Pages
  • 605-612
  • Abstract
  • Open-source software libraries for audio/music analysis and feature extraction have a significant impact on the development of Audio Signal Processing and Music Information Retrieval (MIR) systems. Despite the abundance of such tools on the native computing platforms, there is a lack of an extensive and easy-to-use reference library for audio feature extraction on the Web. In this paper, we present Essentia.js, an open-source JavaScript (JS) library for audio and music analysis on both web clients and JS-based servers. Along with the Web Audio API, it can be used for efficient and robust real-time audio feature extraction on the web browsers. Essentia.js is modular, lightweight, and easy-to-use, deploy, maintain and integrate into the existing plethora of JS libraries and Web technologies. It is powered by a WebAssembly back-end of the Essentia C++ library, which facilitates a JS interface to a wide range of low-level and high-level audio features. It also provides a higher-level JS API and add-on MIR utility modules along with extensive documentation, usage examples, and tutorials. We benchmark the proposed library on two popular web browsers, Node.js engine, and Android devices, comparing it to the native performance of Essentia and Meyda JS library.
  • Complete citation
  • Correya A, Bogdanov D, Jjoglar-Ongay L, Serra X. Essentia.js: a JavaScript library for music and audio analysis on the web. In: Laplante A, Fujinaga I. Proceedings of the 21st International Society for Music Information Retrieval Conference (ISMIR). 1 ed. Montreal: International Society for Music Information Retrieval (ISMIR); 2020. p. 605-612.