research
∙
05/23/2023
Perception Test: A Diagnostic Benchmark for Multimodal Video Models
We propose a novel multimodal video benchmark - the Perception Test - to...
share
research
∙
01/23/2023
Zorro: the masked multimodal transformer
Attention-based models are appealing for multimodal processing because i...
research
∙
11/07/2022
TAP-Vid: A Benchmark for Tracking Any Point in a Video
Generic motion understanding from video involves not only tracking objec...
research
∙
11/23/2021
Towards Learning Universal Audio Representations
The ability to learn universal audio representations that can solve dive...
research
∙
11/28/2020
Human-Agent Cooperation in Bridge Bidding
We introduce a human-compatible reinforcement-learning approach to a coo...
research
∙
10/21/2020
A Short Note on the Kinetics-700-2020 Human Action Dataset
We describe the 2020 edition of the DeepMind Kinetics human action datas...
research
∙
06/29/2020
Self-Supervised MultiModal Versatile Networks
Videos are a rich source of multi-modal supervision. In this work, we le...
research
∙
03/11/2020
Visual Grounding in Video for Unsupervised Word Translation
There are thousands of actively spoken languages on Earth, but a single ...
research
∙
12/13/2019