Jianwei Yang

verfied profile

∙

0 followers

∙

Microsoft

∙

Georgia Institute of Technology

∙

Virginia Polytechnic Institute and State University

Featured Co-authors

Lei Zhang
319 publications
Jianfeng Gao
196 publications
Trevor Darrell
172 publications
Joshua B. Tenenbaum
132 publications
Dhruv Batra
117 publications
Devi Parikh
112 publications
Kai-Wei Chang
106 publications
Yejin Choi
96 publications
Kurt Keutzer
89 publications
Zhe Gan
88 publications
Shih-Fu Chang
87 publications

∙ 04/22/2022

Multimodal Adaptive Distillation for Leveraging Unimodal Encoders for Vision-Language Tasks

Cross-modal encoders for vision-language (VL) tasks are often pretrained...

Zhecan Wang, et al. ∙

∙ 04/20/2022

K-LITE: Learning Transferable Visual Models with External Knowledge

Recent state-of-the-art computer vision systems are trained from natural...

Sheng Shen, et al. ∙

∙ 04/19/2022

ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models

Learning visual representations from natural language supervision has re...

Chunyuan Li, et al. ∙

∙ 04/07/2022

Unified Contrastive Learning in Image-Text-Label Space

Visual recognition is recently learned via either supervised learning on...

Jianwei Yang, et al. ∙

∙ 03/29/2022

Parameter-efficient Fine-tuning for Vision Transformers

In computer vision, it has achieved great success in adapting large-scal...

Xuehai He, et al. ∙

∙ 03/22/2022

Focal Modulation Networks

In this work, we propose focal modulation network (FocalNet in short), w...

Jianwei Yang, et al. ∙

∙ 01/15/2022

CLIP-TD: CLIP Targeted Distillation for Vision-Language Tasks

Contrastive language-image pretraining (CLIP) links vision and language ...

Zhecan Wang, et al. ∙

∙ 12/16/2021

RegionCLIP: Region-based Language-Image Pretraining

Contrastive language-image pretraining (CLIP) using image-text pairs has...

Yiwu Zhong, et al. ∙

∙ 12/07/2021

Grounded Language-Image Pre-training

This paper presents a grounded language-image pre-training (GLIP) model ...

Liunian Harold Li, et al. ∙

∙ 11/22/2021

Florence: A New Foundation Model for Computer Vision

Automated visual understanding of our diverse and open world demands com...

Lu Yuan, et al. ∙

∙ 09/06/2021

Learning to Generate Scene Graph from Natural Language Supervision

Learning from image-text data has demonstrated recent success for many r...

Yiwu Zhong, et al. ∙

∙ 08/23/2021

TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment

Contrastive learning has been widely used to train transformer-based vis...

Jianwei Yang, et al. ∙

∙ 07/27/2021

Image Scene Graph Generation (SGG) Benchmark

There is a surge of interest in image scene graph generation (object, at...

Xiaotian Han, et al. ∙

∙ 07/01/2021

Focal Self-attention for Local-Global Interactions in Vision Transformers

Recently, Vision Transformer and its variants have shown great promise o...

Jianwei Yang, et al. ∙

∙ 06/17/2021

Efficient Self-supervised Vision Transformers for Representation Learning

This paper investigates two techniques for developing efficient self-sup...

Chunyuan Li, et al. ∙

∙ 03/29/2021

Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding

This paper presents a new Vision Transformer (ViT) architecture Multi-Sc...

Pengchuan Zhang, et al. ∙

∙ 01/02/2021

VinVL: Making Visual Representations Matter in Vision-Language Models

This paper presents a detailed study of improving visual representations...

Pengchuan Zhang, et al. ∙

∙ 12/21/2020

Object-Centric Diagnosis of Visual Reasoning

When answering questions about an image, it not only needs knowing what ...

Jianwei Yang, et al. ∙

∙ 11/18/2020

Neuro-Symbolic Representations for Video Captioning: A Case for Leveraging Inductive Biases for Vision and Language

Neuro-symbolic representations have proved effective in learning structu...

Hassan Akbari, et al. ∙

∙ 04/09/2019

Embodied Visual Recognition

Passive visual systems typically fail to recognize objects in the amodal...

Jianwei Yang, et al. ∙

∙ 10/01/2018

Visual Curiosity: Learning to Ask Questions to Learn Visual Recognition

In an open-world setting, it is inevitable that an intelligent agent (e....

Jianwei Yang, et al. ∙

∙ 08/01/2018

Graph R-CNN for Scene Graph Generation

We propose a novel scene graph generation model called Graph R-CNN, that...

Jianwei Yang, et al. ∙

∙ 03/27/2018

Neural Baby Talk

We introduce a novel framework for image captioning that can produce nat...

Jiasen Lu, et al. ∙

∙ 06/05/2017

Best of Both Worlds: Transferring Knowledge from Discriminative Learning to a Generative Visual Dialog Model

We present a novel training framework for neural sequence models, partic...

Jiasen Lu, et al. ∙

∙ 03/05/2017

LR-GAN: Layered Recursive Generative Adversarial Networks for Image Generation

We present LR-GAN: an adversarial image generation model which takes sce...

Jianwei Yang, et al. ∙

∙ 05/31/2016

Hierarchical Question-Image Co-Attention for Visual Question Answering

A number of recent works have proposed attention models for Visual Quest...

Jiasen Lu, et al. ∙

∙ 04/13/2016

Joint Unsupervised Learning of Deep Representations and Image Clusters

In this paper, we propose a recurrent framework for Joint Unsupervised L...

Jianwei Yang, et al. ∙

∙ 08/24/2014

Learn Convolutional Neural Network for Face Anti-Spoofing

Though having achieved some progresses, the hand-crafted texture feature...

Jianwei Yang, et al. ∙