research
∙
05/23/2023
Perception Test: A Diagnostic Benchmark for Multimodal Video Models
We propose a novel multimodal video benchmark - the Perception Test - to...
share
research
∙
10/31/2022
A Simple, Yet Effective Approach to Finding Biases in Code Generation
Recently, scores of high-performing code generation systems have surface...
research
∙
10/06/2022
Compressed Vision for Efficient Video Understanding
Experience and reasoning occur across multiple temporal scales: millisec...
research
∙
08/18/2022
Neural Payoff Machines: Predicting Fair and Stable Payoff Allocations Among Team Members
In many multi-agent settings, participants can form teams to achieve col...
research
∙
05/06/2022
CLIP-CLOP: CLIP-Guided Collage and Photomontage
The unabated mystique of large-scale neural networks, such as the CLIP d...
research
∙
03/17/2022
Transframer: Arbitrary Frame Prediction with Generative Models
We present a general-purpose framework for image modelling and vision ta...
research
∙
02/24/2022
Measuring CLEVRness: Blackbox testing of Visual Reasoning Models
How can we measure the reasoning capabilities of intelligence systems? V...
research
∙
02/15/2022
General-purpose, long-context autoregressive modeling with Perceiver AR
Real-world data is high-dimensional: a book, image, or musical performan...
research
∙
07/20/2021
Learning Altruistic Behaviours in Reinforcement Learning without External Rewards
Can artificial agents learn to assist others in achieving their goals wi...
research
∙
06/07/2021
Measuring and Improving BERT's Mathematical Abilities by Predicting the Order of Reasoning
Imagine you are in a supermarket. You have two bananas in your basket an...
research
∙
03/30/2021
Broaden Your Views for Self-Supervised Video Learning
Most successful self-supervised learning methods are trained to align th...
research
∙
06/18/2020
IReEn: Iterative Reverse-Engineering of Black-Box Functions via Neural Program Synthesis
In this work, we investigate the problem of revealing the functionality ...
research
∙
03/11/2020
Visual Grounding in Video for Unsupervised Word Translation
There are thousands of actively spoken languages on Earth, but a single ...
research
∙
06/04/2019
Learning dynamic polynomial proofs
Polynomial inequalities lie at the heart of many mathematical discipline...
research
∙
03/04/2019
The StreetLearn Environment and Dataset
Navigation is a rich and well-grounded problem domain that drives progre...
research
∙
03/01/2019
Learning To Follow Directions in Street View
Navigating and understanding the real world remains a key challenge in m...
research
∙
12/03/2018
Generating Diverse Programs with Instruction Conditioned Reinforced Adversarial Learning
Advances in Deep Reinforcement Learning have led to agents that perform ...
research
∙
09/20/2018
Playing the Game of Universal Adversarial Perturbations
We study the problem of learning classifiers robust to universal adversa...
research
∙
09/11/2018
The Visual QA Devil in the Details: The Impact of Early Fusion and Batch Norm on CLEVR
Visual QA is a pivotal challenge for higher-level reasoning, requiring u...
research
∙
08/01/2018
Learning Visual Question Answering by Bootstrapping Hard Attention
Attention mechanisms in biological perception are thought to select subs...
research
∙
06/04/2018
Relational inductive biases, deep learning, and graph networks
Artificial intelligence (AI) has undergone a renaissance recently, makin...
research
∙
05/24/2018
Hyperbolic Attention Networks
We introduce hyperbolic attention networks to endow neural networks with...
research
∙
03/31/2018
Learning to Navigate in Cities Without a Map
Navigating through unstructured environments is a basic capability of in...
research
∙
06/05/2017
A simple neural network module for relational reasoning
Relational reasoning is a central component of generally intelligent beh...
research
∙
11/27/2016
Long-Term Image Boundary Prediction
Boundary estimation in images and videos has been a very active topic of...
research
∙
10/04/2016
Tutorial on Answering Questions about Images with Deep Learning
Together with the development of more accurate methods in Computer Visio...
research
∙
08/09/2016
Mean Box Pooling: A Rich Image Representation and Output Embedding for the Visual Madlibs Task
We present Mean Box Pooling, a novel visual representation that pools ov...
research
∙
05/24/2016
Spatio-Temporal Image Boundary Extrapolation
Boundary prediction in images as well as video has been a very active to...
research
∙
05/09/2016
Ask Your Neurons: A Deep Learning Approach to Visual Question Answering
We address a question answering task on real-world images that is set up...
research
∙
03/29/2016
Multi-Cue Zero-Shot Learning with Strong Supervision
Scaling up visual category recognition to large numbers of classes remai...
research
∙
02/16/2016
Contextual Media Retrieval Using Natural Language Queries
The widespread integration of cameras in hand-held and head-worn devices...
research
∙
05/05/2015
Ask Your Neurons: A Neural-based Approach to Answering Questions about Images
We address a question answering task on real-world images that is set up...
research
∙
01/14/2015
Hard to Cheat: A Turing Test based on Answering Questions about Images
Progress in language and image understanding by machines has sparkled th...
research
∙
11/19/2014
A Pooling Approach to Modelling Spatial Relations for Image Retrieval and Annotation
Over the last two decades we have witnessed strong progress on modeling ...
research
∙
10/29/2014
Towards a Visual Turing Challenge
As language and visual understanding by machines progresses rapidly, we ...
research
∙
10/01/2014
A Multi-World Approach to Question Answering about Real-World Scenes based on Uncertain Input
We propose a method for automatically answering questions about images b...
research
∙
01/15/2013
