Transformers

AI Assets related to #Transformers

ML Model

Efficient Training of Visual Transformers with Small Datasets

A tool to allow Visual Transformers (VTs) to learn spatial relations within an image making the VT training much more robust when training data is scarce. The tool can be used jointly with the standard (supervised) training and it does not depend on speci...

ML Model

CGTransformer

PyTorch implementation of a Geometry-Contrastive Transformer for Generalized 3D Pose Transfer. The novel GC-Transformer can freely conduct robust pose transfer on LARGE meshes at no cost, which could be a boost to Transformers in 3D fields.

ML Model

AniFormer

PyTorch implementation of AniFormer, a novel Transformer-based architecture, that generates animated 3D sequences by directly taking the raw driving sequences and arbitrary same-type target meshes as inputs. The Transformer architecture is customised for ...

Education resources related to #Transformers

Neural Speech Recognition Lecture

Acoustic digital signals are ubiquitous and have many applications in several disciplines, notably in: -Digital Media, Social Media (music, voice signals), -Biomedical Signal Analysis and Diagnosis, -Scientific signal acquisition of any sort, e.g., E...

Attention and Transformers Networks Lecture

Nowadays, Artificial Intelligence drives scientific and economic growth worldwide. This is largely due to advances in Machine Learning (ML), notably in Deep Neural Networks (DNNs), which are essentially massive ‘learning by experience/examples’ systems. T...

Neural Networks and Deep Learning Module

Multimodal Perception and Interaction with Transformers

A 4 hour tutorial presented in October 2021 at ACAI 2021 on Multimodal Perception and Interaction with Transformers

Research Bundles related to this topic

INRIA

Multimodal Perception and Interaction with Transformers

This micro-project surveys tools and data sets for experiments for demonstrating the potential use of transformers for multimodal perception and multimodal interactions.