Collection of datasets tailored for HumanE-AI multimodal perception and modelling
We share through the datasets already collected so far by different research groups
Often, researchers struggle to progress for the lack of data. At the same time, collecting a rich and accurate dataset is no easy task. Therefore, we shared through this bundle the datasets already collected so far by different research groups. The datasets are curated to be ready-to-use for researchers.
Possible extensions and variations of such datasets have also been generated using artificial techniques.
A performance baseline is provided for each dataset, in the form of publication reference, developed model, or written documentation.
We investigated the relevant legal framework with specific attention to privacy and data protection to highlight limitations and challenges regarding the use and extension of existing datasets and future data collection on the subject of multimodal data collection for perception modeling.
Output
- Publication of OPPORTUNITY dataset (and other datasets if time available) on the AI4EU platform. [lead: UoS, contributor: DFKI]
- Publication of baseline performance pipeline for OPPORTUNITY dataset (and other datasets if time available) on AI4EU platform. [lead: UoS, contributor: DFKI]
- Investigation of data loader and pipeline integration on AI4EU experiment to load HAR dataset and pre-existent pipelines, with a focus on the opportunity dataset (and other datasets if time available) [lead: UoS, contributor: DFKI]
- Generation of variation [lead: DFKI]
- Survey publications describing datasets and performance baseline [lead: DFKI, contributor: UoS]
This Humane-AI-Net micro-project was carried out by University of Sussex (UOS, Mathias Ciliberto), German Research Centre for Artificial Intelligence (DFKI, Vitor Fortes Rey) and Vrije Universiteit Brussel (VUB, Arno de Bois).
Assets related to Collection of datasets tailored for HumanE-AI multimodal perception and modelling
DFKI