The purpose of this document is to provide all project beneficiaries with a summary of the most important project procedures (governance structure, legal bases, project monitoring, reporting, financial management, internal communication, etc.). Additionally, this document comprises beneficiaries and contact lists as well as documentation and communication standards in order to enable quick and efficient communication within the project consortium.
This deliverable reports on the data plan strategy for the PRESENT project. The deliverable summarises and discusses the type of data which the project will be dealing with, and especially in terms of its potential release.
This document sets out the principles, procedures and criteria to be applied for the self-assessment and internal progress monitoring of the project. It complements the D1.1 Project Handbook and Quality PlanD1.2 Data Management Plan as well as the dissemination and exploitation planning deliverables in WP9.
This document presents the results of the Task 2.1 Scenarios and Pipelines (M1 – M6). The task
consolidated the scenarios of use for demonstration and evaluation, and the pipelines for ensuring
integration and multiple output.
This document represents the initial architecture that will govern the overall design and deliverables associated with the ICT25 PRESENT project. The goal is to provide a high level overview of the various components required to deliver the overall functionality.
This deliverable represents the initial architecture that will govern the overall design and deliverables associated with the PRESENT project. The goal is to provide a high level overview of the various components required to deliver the overall functionality.
This document provides the background and current progress, including the look development of the real-time agent creation and the demonstration of the agent inside Unreal Engine.
This Deliverable describes the full pipeline developed to produce facial animation on the virtual agent from the performance of the real actor. The key innovations introduced in the different elements of the workflow are presented together with encouraging preliminary results.
This Deliverable describes the research developed to produce synthetic body animation on the virtual agent starting from the performance of the real actor. Our methods, progress and early results are documented.
This deliverable focuses on the methodology employed to create the background agents for Present and to add support for those agents into the shared project structure or reference implementation. The document also presents the case for a pivot in focus away from the compositing of realtime content into offline content that was included in the original proposal. An alternative approach is presented that involves including all content in a single interactive scene.
This Report describes the research developed to drive the facial animation of the digital agent. Our methods, progress and results are documented.
This Deliverable describes the research developed to produce synthetic body animation on the virtual agent starting from the performance of the real actor. Our methods, progress and results are documented.
In this deliverable, we describe our efforts conducted in the first period of the project to provide the PRESENT agent with the necessary non-verbal behaviour to be positively perceived as a sentient being during interaction with the user regarding the mentioned behaviour styles.
Within this document we describe the current state of the PRESENT real-time social sensing system in detail, present a first demonstrator for affective dialogue management and introduce the upcoming extensions of the sensing system.
This deliverable reports our achievements along the following main directions: (i) provide designers friendly tool to extend in large amounts the believability, expressivity and richness of collective behaviors for agents; (ii) create new animation techniques to extend the expressivity of characters animation with possibility to perform on-line adjustments of the conveyed information through body gestures; (iii) explore new modalities for non-verbal communication with users with haptic techniques. The document also describes the explored techniques in their current version after slightly more than one year of developments within the project.
This deliverable reports the work that was conducted in order to enhance the non-verbal behavioural capabilities of the PRESENT virtual agent.
In this report period we finalized the audiovisual emotion recognition pipeline, which forms the core of the PRESENT social sensing system. The system operates within the dimensional valence and arousal space to recognize, process and communicate affective states. It currently features analysis of the vocal modality for voice activity detection and sentence segmentation, as well as arousal recognition from paralinguistic characteristics. From the video stream we analyse facial expressions to determine valence and arousal scores. The audiovisual information is merged within a sophisticated asynchronous fusion model, delivering the final assessment.
Development of the final version for a Socially-Aware Reinforcement Learning simulation as well as a live system.
This deliverable presents a set of techniques that aim at providing virtual humans with the ability to react and interact with a user, in a non-verbal communication mode that involves, proxemics, gestures or gaze behaviours for characters. We also explore the role of touch sensation on user behaviour.
A formal study on the needs regarding specific statements to provide privacy in the blockchain setting.
This document details the infrastructure design of the security module of PRESENT. Detailed explanations about the tools used to implement it and descriptions about the different capabilities and functionalities of the module are provided.
This document provides details about the implementation of the security module of PRESENT. Detailed explanations about the tools used to implement it and descriptions about the different capabilities and functionalities of the module are provided. The design of the security module is described in Deliverable 5.2 which should be read before reading this document. Deliverable 5.1 also is relevant since it discusses the general approach that we use to manage verifiable credentials in a distributed setting.
The goal of this document is to provide a protocol based on a type of zero-knowledge arguments called Bulletproofs to generate proofs for statements relevant to PRESENT. We do not only provide a single protocol but two efficient libraries that can be used to prove a wide variety of statements. Moreover, we introduce a new use-case scenario where we use PRESENT virtual agents to provide security and trust based on the capabilities of Bulletproofs.
This deliverable presents the overall structure of the reference implementation as well as the protocols and specifications developers can use to successfully contribute components to the reference implementation project.
This document provides details about the implementation of the security module of PRESENT. The goal of the security module is that pf checking the identities of the parties involved in the interaction. Deliverable 5.1 provides a discussion about the general approach for the use of verifiable credentials (and thus identities) in a distributed setting. Deliverable 5.2 provides the design of the security infrastructure. Deliverable 5.3 describes a preliminary version of the software. This deliverable describes the final version.
A formal study on the models and technology for the interaction between software agents.
Demonstration of the developments undertaken in the areas of realtime rigging and the translation of high fidelity character shading from offline rendering to realtime.
This Report describes the research carried out to generate facial animation for the digital agent. Our methods, progress and results are documented.
This Report describes the research developed to generate body animation for the digital agent. Our methods, progress and results are documented.
Key aspects of the demonstrator of the proof of concept high- quality virtual character player with a very high degree of integrability undertaken mainly by UPF-GTI within the PRESENT project.
Current wor ks on the Vir tual Studio pipeline focus on the adaptation of InfinitySet for the incorporation and use of Unreal Engine and on the implementation of the required modules in Unreal Engine to allow communication between the two graphic engines. This document details the architecture design for this integration, the functionality of each of its modules, and the required implementation to cover the requirements and needs identified in the broadcast use case described in WP2.
This document describes the activities carried out to integrate the virtual studio and the agent in order to make available the current set of functionalities provided by the agent from Unreal Engine and the new capabilities implemented in InfinitySet. It introduces all these functionalities, describes the Proof of Concept made available through this integration, and finally provides very brief instructions to set the environment up and test it.
Works on the Virtual Studio pipeline have focused on the adaptation of InfinitySet for the incorporation and use of Unreal Engine and on the implementation of the required modules in Unreal Engine to allow communication between the two graphic engines. This document details the architecture design for this integration, the functionality of each of its modules, and the final implementation required to cover the requirements and needs identified in the broadcast use case described in WP2.
This document describes the activities carried out to make available all the functionalities provided by the agent from Unreal Engine, as well as the new capabilities implemented in InfinitySet to make them available in InfinitySet. It describes the integration of the virtual studio and the agent, and all the functionalities of the system.
Key aspects of the realtime agent integration architecture and functionality along with demonstrations of the adaptation of that architecture to meet a wide variety of use case needs.
This report discusses “how the partners plan to evaluate the sentient agent under the different scenarios for experimental production and prototype evaluation”, as stated in the Description of Action (DoA). The core of the document is section 3 contains initial evaluation plans for each use case, at each subsection. The use cases, presented in another deliverable, represent the evolution and detail of the experimental production(s) and prototypes. Section 2 introduces the general methodology and the context of the deliverable, and the final section summarises the plans and discusses the perspectives for their updating.
Interim evaluation of the experimental productions as described in WP8. This report describes the developed concepts, methods and technologies for the productions. Most of the work has been preparatory to lay a foundation for integrating the results of other work packages. The report explains the relationship between the Use Cases and the Experimental Productions, their implementations and possible assessment. The project concludes that significant work has been done, but that the next stage of implementation of partner’s components and tools will be crucial.
Report describing the interim evaluations carried out by FS, BRA and ICERT.
Description and evaluation of the Experimental Productions (EP), and assessment of the tools that were developed by the technical partners Inria, UAU, CM, FS, challenged for integration in the Eps.
This document reports the obtained results during the final prototype evaluations
The purpose of this document is to provide the rationale of the project website implementation.
Report on exploitation activities in the previous year with an update of the plan for exploitation and use of knowledge, based on market knowledge, with sector analysis, SWOT and partner routes to exploitation.
Report on the update of the exploitation and dissemination activities including an update of the individual exploitation plans and including the CANVAS model and the first financial estimations.
This report serves as documentation for the Final Showcase Demonstration, that has taken place at two major events (FMX; SIGGRAPH), highlighting the different components of the project.
Report on the Final Exploitation Plan including the individual exploitation plans and including the CANVAS model and the first financial estimations.
Report on dissemination activities throughout the project, including website, social media, conferences, press releases and academic papers.