This micro-project has surveyed tools and data sets for experiments for demonstrating the potential use of transformers for multimodal perception and multimodal interactions. We have provided tutorials on the use of transformers for multimodal perception and interaction, as well as a  survey presentation of research challenges and data sets and suvey report on tools and source code for research on multimodal perception and interaction.

The goal has been to explore and promote the use of transformers and self-attention for multimodal modal interaction, by providing tutorials and training materials for education, by identifying relevant software tools, benchmark data sets and research challenges for research on multimodal perception and interaction.