We develop a large number of software tools and hosting infrastructures to support the research developed at the Department. We will be detailing in this section the different tools available. You can take a look for the moment at the offer available within the UPF Knowledge Portal, the innovations created in the context of EU projects in the Innovation Radar and the software sections of some of our research groups:

 

 Artificial Intelligence

 Nonlinear Time Series Analysis

 Web Research 

 

 Music Technology

 Interactive  Technologies

 Barcelona MedTech

 Natural Language  Processing

 Nonlinear Time Series  Analysis

UbicaLab

Wireless Networking

Educational Technologies

GitHub

 

 


ROS package implementing a 2D exploration framework for 3D mapping with RGBD camera(s).

It works along with the rtabmap_ros ROS package. More information and instructions in their Github page.

It can work with any RGBD camera (and laser scan) configuration allowed in rtabmap_ros. The point cloud ground projection is used for exploration purposes.

This framework allow to choose many strategic decision from command line.


This simple and generic viewer allows you to visualize different kinds of data such as medical and biological images, 3D surfaces, electric signals (ECGs) and documents.

Rocket viewer allows visualizing data from the web or loading information from the local file system by simply dragging and dropping a file into the browser.

Rocket viewer is © Universitat Pompeu Fabra 2017. Original Developers: Carlos Yagüe Méndez, María del Pilar García, Daniele Pezzatini. Contributors: Sergio Sánchez Martínez, Oscar Cámara, Bart Bijnens.

Compatible formats

  • Medical images:DICOM (one frame = 2D visualization, multi-frame = 2D visualization + t)
  • Biological images: TIFF
  • Signals: PDF
  • Surfaces: VTK (3D Visualization), PLY (3D Visualization)
  • Surfaces + Medical images: NRRD (3D Visualization)
  • Electric signals: CSV files

Cite as

Carlos Yagüe. (2018, January 31). bcnmedtech/rocket_viewer: Rocket viewer – V1.0 (Version 1.0). Zenodo. http://doi.org/10.5281/zenodo.1163519

Try the viewer here

Details and download https://github.com/bcnmedtech/rocket_viewer


Spatial Flexible Continuous Time Markov Network (SFCTMN)

Continuous Time Markov Network (CTMN) based framework for analyzing Wireless Local Area Networks (WLANs) implementing Dynamic Channel Bonding (DCB) policies in spatially distributed scenarios, where WLANs are not required to be within the carrier sense range of each other. Details on the framework can be found at S. Barrachina-Muñoz, F. Wilhelmi, and B. Bellalta. Performance of Dynamic Channel Bonding in Spatially Distributed High Density WLANs. arXiv preprint arXiv:1801.00594, 2018.

Access to code at https://github.com/sergiobarra/SFCTMN


 

Komondor: An IEEE 802.11ax Simulator

The Komondor Simulator has been built to simulate the behavior of overlapping WLANs according to their configuration. Komondor is mainly oriented to simulate the behavior of IEEE 802.11ax WLANs, which has not been considered in the current State-of-the-Art simulators. In addition, it has been prepared for a simple integration of intelligent agents that modify the nodes configuration for improving the network performance.

Additional details and access to code at https://github.com/wn-upf/Komondor


You can use our freely online tool to parse yours PDF files. Our approach is based on the PDFdigest tool, a PDF textual content extraction system specially designed to extract scientific articles' headings and logical structure (title, authors, abstract and so on) and its textual content to. The result is provided in a XML file. Furthermore, PDFdigest also provides a structured HTML file as a clone of the original PDF file.

In addition, the pre-processing step implemented in DrInventor (link) is applied to the previous XML file in order to mark off tokens and sentences. As a result, we also provide an additional GATE document.

Details at http://scientmin.taln.upf.edu/pdfdigest/pdfparser.php


PyramidApp: scalable technological approach facilitating flexible collaborative learning following Pyramid or Snowball collaborative learning flow pattern

The objective of the tool is to allow students to learn from peers in the process of proposing options, discussing and selecting the best option(s)! Practitioners are able to monitor on-going pyramid activities and view the winning options in order to discuss further.

Using PyramidApp authoring tool, practitioners can design activities that can be enacted in any preferred education context. Students will use PyramidApp to access the activity and submit individual option (which can be a question, comment, suggestion, or even a link of a created resource) for a given task. Students will be able to collaboratively discuss and negotiate upon a common agreed option in groups and rate those options iteratively following a snowball or pyramid structure till the complete crowd reaches a global consensus on the most interesting option(s).


Web implementation of the extension of Praat for feature annotation also available for local use and downloadable separately from the following repository https://github.com/monikaUPF/featureAnnotationforPraat.

A tutorial on the use of the basic functions of the web implementation of Praat for feature annotations is available in the following link https://youtu.be/sJXu15Dskjs

The link to the web application is http://kristina.taln.upf.edu/praatweb/ and it is described in our publication (Domínguez et al. 2016)


Prosograph: A Visualizer for prosodically annotated speech corpora written in Processing

 


Automated programming framework

UNIVERSAL PDDL PARSER

  • The parser is included in the repository and is compiled when you run scons in the main directory

PLANNERS

Fast-Downward

  • Is compiled when you run scons
  • There are few required libraries like bison, flex, g++ and python
  • For more information go to the planner webpage

TARTARUS: Deep Learning for audio and text

Tartarus is a python module for Deep Learning experiments on Audio and Text and their combination


Smart Carpooling demo using a temporal planner

Planning experiments in the smart mobility domain

For more software by the Artificial Intelligence and Machine Learning Research Group, please check:

https://github.com/aig-upf

First release:

https://zenodo.org/record/1255141

DOI: 10.5281/zenodo.1255140

 


Algorithms for solving temporal planning problems

The planner is a modified version of the Fast Downward distribution to support temporal planning.

References:


The multiagent extension for the PDDL parser

An extension to the Universal PDDL Parser to handle multi-agent domains.

http://doi.org/10.5281/zenodo.2593129

https://github.com/aig-upf/universal-pddl-parser-multiagent


TxMEx: Transaction Message Exchange

Transaction Message Exchange (TxMEx) enables Bitcoin nodes to send and receive transaction-embedded messages of arbitrary length

DOI: https://doi.org/10.5281/zenodo.803319


Freesound - Collaborative database of creative-commons licensed sound for musicians and sound lovers

Freesound is a community-driven repository of sound samples that was started in 2005 in our research group. One of the first aims behind Freesound was creating an open database of sounds that could also be used for scientific research. Currently, Freesound is one of the most popular sound sharing sites in the world. Freesound (and the Freesound API) is being maintained and developed at the MTG by the Freesound team, which is basically composed by current and former researchers and students of the research group.

With the Freesound API you can browse, search, and retrieve information about Freesound.org users, packs, and the sounds themselves of course. You can find similar sounds to a given target (based on content analysis) and retrieve automatically extracted features from audio files, as well as perform advanced queries combining content analysis features and other metadata (tags, etc...). With the Freesound API, you can also upload, comment, rate and bookmark sounds.


TaxoEmbed - hypernym detection algorithm

Hypernym detection algorithm based on sense embeddings, which can be easily applied to the construction of lexical taxonomies. It is designed to discover hypernymic relations by exploiting linear transformations in embedding spaces and, unlike previous approaches, leverages this intuition to learn a specific semantically aware transformation matrix for each domain ofknowledge.


The ILDE supports cooperation within "learning design" communities in which their members share and co-create multiple types of learning design solutions covering the complete lifecycle. This has been achieved by the integration of a number of existing free-and open-source tools. ILDE uses the LdShake platform to provide social networking features and to manage the integrated access to designs and tooling including conceptualization tools (OULDI templates), editors (WebCollage, OpenGLM), and deployment into VLEs (e.g., Moodle) via GLUE!-PS

See: Hernández-Leo, D., Asensio-Pérez, J.I., Derntl, M., Prieto, L.P., Chacón, J., (2014) ILDE: Community Environment for Conceptualizing, Authoring and Deploying Learning Activities. In: Proceedings of 9th European Conference on Technology Enhanced Learning, pp. 490-493.

 

For other publications associated to this line of research please visit here


Essentia is an open-source C++ library for audio analysis and audio-based music information retrieval released under the Affero GPLv3 license (also available under proprietary license upon request). It contains an extensive collection of reusable algorithms which implement audio input/output functionality, standard digital signal processing blocks, statistical characterization of data, and a large set of spectral, temporal, tonal and high-level music descriptors. In addition, Essentia can be complemented with Gaia, a C++ library with python bindings which implement similarity measures and classifications on the results of audio analysis, and generate classification models that Essentia can use to compute high-level description of music (same license terms apply).

Essentia is not a framework, but rather a collection of algorithms (plus some infrastructure) wrapped in a library. It doesn’t provide common high-level logic for descriptor computation (so you aren’t locked into a certain way of doing things). It rather focuses on the robustness, performance and optimality of the provided algorithms, as well as ease of use. The flow of the analysis is decided and implemented by the user, while Essentia is taking care of the implementation details of the algorithms being used. A number of predefined executable extractors for the available music descriptors are provided with the library as examples, however they should not be considered as the only correct way of doing things.

Get to know more at http://essentia.upf.edu/


Dr. Inventor Text Mining Framework is a Java library that integrates several Document Engeneering and Natural Language Processing tools customized to enable and ease the analysis of the textual contents of scientific publications.


Dr. Inventor Text Mining Framework is a standalone Java library that enable users to process the contents of papers both in PDF and JATS XML format. Once imported a paper from a local file or a remote URL, the Framework automatically extracts and characterizes several aspects including:

  • Structural elements: title, abstract, hierarchy of sections, sentences inside each section, bibliographic entries
  • Bibliographic entries are parsed and enriched by accessing external web services (Bibsonomy, CrossRef, FreeCite, Google Scholar)
  • Inline citations are spotted and linked to the respective bibliographic entry
  • The dependency tree is built from each sentence by considering inline citations
  • The discoursive category of each sentence is identified among: Background, Challenge, Approach, Outcome and Future Work
  • BabelNet synsets are spotted inside the contents of each sentence thanks to Babelfy
  • Subject-Verb-Object graphs are build to represent the contents of paper excerpts (the connectedness of these graphs is enhanced thanks to coreference resolution)
  • Relevant sentences are selected with respect to several criteria to build extractive summaries of a paper
  • etc.

Ronzano, F., & Saggion, H.: Dr. Inventor Framework: Extracting Structured Information from Scientific Publications. Discovery Science (pp. 209-220). Springer International Publishing. (2015)


SUMMA is a text summarization toolkit which follows the architectural precepts of the GATE framework therefore providing much needed functionality in the form of language and processing resources for composition of practical summarization applications.

SUMMA main features

  • Resources for statistical text analysis
  • Resources for features computation
  • Resources for customization of summaries
  • Resources for exporting results
  • Single-document summarization
  • Multi-document summarization
  • Multilingual processing
  • Ready-made summarizers and baselines for research comparison
  • Easy to install and use
  • Easy to extend
  • Easy to customize

Online debate tools in participatory democracy and crowdsourcing legislation remains limited by several factors. One of them arises when discussion of proposals reach a large number of contributions and therefore citizens encounter difficulties in mapping the arguments that constitute the dialectical debate.

To address this issue, this visualization tool shows the discussion of a debate/proposal. The tool builds on Decide Madrid, the platform for direct democracy launched by the City Council of Madrid in September 2015. Discussions are visualized hierarchically as an interactive radial tree in which the root node corresponds to the proposal and the rest of the nodes correspond to the comments from the users. To highlight the arborescence of the discussion and to distinguish the arguments of every branch of the thread, the tool applies a flexible force-directed graph layout that accelerates charge interaction through the Barnes-Hut approximation. In addition, to identify the messages that receive more attention, the tree layout of the discussion includes additional information, such as positive or negative votes that are associated with individual comments. The size and colour of the nodes is determined according to the number of votes and the ratio of positive/negative votes, respectively:

  • Black: Root (proposal)
  • Grey: Comment with no votes
  • Green (scale): Comment with majority of positive votes
  • Red (scale): Comment with majority of negative votes
  • Orange: Comment with no strong preference of positive or negative votes

The visualization also includes an informative panel with the description of the tool and the metadata of a node (author, message, date and positive/negative votes) when the user rolls the mouse over it.

More info about this tool can be found at the D-CENT deliverable: From Citizen Data to Wisdom of the Crowd

See more details at https://github.com/elaragon/decideviz


WebGLStudio is a set of web graphics libraries. The main application is a platform to create interactive 3D scenes directly from the browser. It allows to edit the scene visually, code your behaviours, edit the shaders, and all directly from within the app. The libraries have over 1.600 stars in GitHub (April 2016).

 

WebGLStudio Basic Demo from Javi Tamat on Vimeo.

 

To know more:


RepoVizz is a data repository and visualization tool for structured storage and user-friendly browsing of music performance multi-modal recordings. The primary purpose of RepoVizz is to offer means for the scientific community to gain on-line access to a music performance multi-modal database shared among researchers.