research
∙
06/17/2022
Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Tasks
We propose Unified-IO, a model that performs a large variety of AI tasks...
share
research
∙
06/04/2021
MERLOT: Multimodal Neural Script Knowledge Models
As humans, we understand events in the visual world contextually, perfor...
research
∙
06/01/2021
PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World
We propose PIGLeT: a model that learns physical commonsense knowledge th...
research
∙
02/02/2021
MAUVE: Human-Machine Divergence Curves for Evaluating Open-Ended Text Generation
Despite major advances in open-ended text generation, there has been lim...
research
∙
12/08/2020
Edited Media Understanding: Reasoning About Implications of Manipulated Images
Multimodal disinformation, from `deepfakes' to simple edits that deceive...
research
∙
10/24/2020
NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraints
Conditional text generation often requires lexical constraints, i.e., wh...
research
∙
05/01/2020
Probing Text Models for Common Ground with Visual Representations
Vision, as a central component of human perception, plays a fundamental ...
research
∙
04/07/2020
Evaluating Machines by their Real-World Language Use
There is a fundamental gap between how humans understand and use languag...
research
∙
02/10/2020
Adversarial Filters of Dataset Biases
Large neural models have demonstrated human-level performance on languag...
research
∙
11/26/2019
PIQA: Reasoning about Physical Commonsense in Natural Language
To apply eyeshadow without a brush, should I use a cotton swab or a toot...
research
∙
05/29/2019
Defending Against Neural Fake News
Recent progress in natural language generation has raised dual-use conce...
research
∙
05/19/2019
HellaSwag: Can a Machine Really Finish Your Sentence?
Recent work by Zellers et al. (2018) introduced a new task of commonsens...
research
∙
11/27/2018
From Recognition to Cognition: Visual Commonsense Reasoning
Visual understanding goes well beyond object recognition. With one glanc...
research
∙
08/16/2018
SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference
Given a partial description like "she opened the hood of the car," human...
research
∙
11/17/2017
Neural Motifs: Scene Graph Parsing with Global Context
We investigate the problem of producing structured graph representations...
research
∙
07/29/2017
Zero-Shot Activity Recognition with Verb Attribute Induction
In this paper, we investigate large-scale zero-shot activity recognition...
research
∙
06/20/2016