b'Jianlong Fu'

research

∙ 11/22/2022

Weakly-supervised Pre-training for 3D Human Pose Estimation via Perspective Knowledge

Modern deep learning-based 3D pose estimation approaches require plenty ...

0 Zhongwei Qiu, et al. ∙

research

∙ 09/14/2022

CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignment

The pre-trained image-text models, like CLIP, have demonstrated the stro...

0 Hongwei Xue, et al. ∙

research

∙ 08/10/2022

Exploring Anchor-based Detection for Ego4D Natural Language Query

In this paper we provide the technique report of Ego4D natural language ...

0 Sipeng Zheng, et al. ∙

research

∙ 08/08/2022

GRIT-VLP: Grouped Mini-batch Sampling for Efficient Vision and Language Pre-training

Most of the currently existing vision and language pre-training (VLP) me...

0 Jaeseok Byun, et al. ∙

research

∙ 07/21/2022

TinyViT: Fast Pretraining Distillation for Small Vision Transformers

Vision transformer (ViT) recently has drawn great attention in computer ...

0 Kan Wu, et al. ∙

research

∙ 04/14/2022

MiniViT: Compressing Vision Transformers with Weight Multiplexing

Vision Transformer (ViT) models have recently drawn much attention in co...

0 Jinnian Zhang, et al. ∙

research

∙ 11/29/2021

Searching the Search Space of Vision Transformer

Vision Transformer has shown great visual representation power in substa...

0 Minghao Chen, et al. ∙

research

∙ 11/19/2021

Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions

We study joint video and language (VL) pre-training to enable cross-moda...

0 Hongwei Xue, et al. ∙

research

∙ 11/05/2021

Improving Visual Quality of Image Synthesis by A Token-based Generator with Transformers

We present a new perspective of achieving image synthesis by viewing thi...

12 Yanhong Zeng, et al. ∙

research

∙ 10/19/2021

A Picture is Worth a Thousand Words: A Unified System for Diverse Captions and Rich Images Generation

A creative image-and-text generative AI system mimics humans' extraordin...

0 Yupan Huang, et al. ∙

research

∙ 09/06/2021

Learning Fine-Grained Motion Embedding for Landscape Animation

In this paper we focus on landscape animation, which aims to generate ti...

0 Hongwei Xue, et al. ∙

research

∙ 08/18/2021

Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment

An important scenario for image quality assessment (IQA) is to evaluate ...

0 Heliang Zheng, et al. ∙

research

∙ 08/10/2021

Reference-based Defect Detection Network

The defect detection task can be regarded as a realistic scenario of obj...

5 Zhaoyang Zeng, et al. ∙

research

∙ 08/10/2021

Domain-Aware Universal Style Transfer

Style transfer aims to reproduce content images with the styles from ref...

0 Kibeom Hong, et al. ∙

research

∙ 07/29/2021

Rethinking and Improving Relative Position Encoding for Vision Transformer

Relative position encoding (RPE) is important for transformer to capture...

0 Kan Wu, et al. ∙

research

∙ 07/01/2021

AutoFormer: Searching Transformers for Visual Recognition

Recently, pure transformer-based models have shown great potentials for ...

0 Minghao Chen, et al. ∙

research

∙ 06/25/2021

Probing Inter-modality: Visual Parsing with Self-Attention for Vision-Language Pre-training

Vision-Language Pre-training (VLP) aims to learn multi-modal representat...

0 Hongwei Xue, et al. ∙

research

∙ 04/29/2021

LightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture Search

Object tracking has achieved significant progress over the past few year...

0 Bin Yan, et al. ∙

research

∙ 04/07/2021

Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning

We study joint learning of Convolutional Neural Network (CNN) and Transf...

0 Zhicheng Huang, et al. ∙

research

∙ 04/05/2021

3D Human Body Reshaping with Anthropometric Modeling

Reshaping accurate and realistic 3D human bodies from anthropometric par...

2 Yanhong Zeng, et al. ∙

research

∙ 04/03/2021

Aggregated Contextual Transformations for High-Resolution Image Inpainting

State-of-the-art image inpainting approaches can suffer from generating ...

5 Yanhong Zeng, et al. ∙

research

∙ 04/01/2021

One-Shot Neural Ensemble Architecture Search by Diversity-Guided Search Space Shrinking

Despite remarkable progress achieved, most neural architecture search (N...

0 Minghao Chen, et al. ∙

research

∙ 03/31/2021

Learning Spatio-Temporal Transformer for Visual Tracking

In this paper, we present a new tracking architecture with an encoder-de...

0 Bin Yan, et al. ∙

research

∙ 12/04/2020

Multi-Scale 2D Temporal Adjacent Networks for Moment Localization with Natural Language

We address the problem of retrieving a specific moment from an untrimmed...

0 Houwen Peng, et al. ∙

research

∙ 10/29/2020

Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search

One-shot weight sharing methods have recently drawn great attention in n...

0 Houwen Peng, et al. ∙

research

∙ 08/22/2020

Revisiting Anchor Mechanisms for Temporal Action Localization

Most of the current action localization methods follow an anchor-based p...

12 Le Yang, et al. ∙

research

∙ 07/20/2020

Learning Joint Spatial-Temporal Transformations for Video Inpainting

High-quality video inpainting that completes missing regions in video fr...

0 Yanhong Zeng, et al. ∙

research

∙ 06/07/2020

Learning Texture Transformer Network for Image Super-Resolution

We study on image super-resolution (SR), which aims to recover realistic...

0 Fuzhi Yang, et al. ∙

research

∙ 06/04/2020

M3P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training

This paper presents a Multitask Multilingual Multimodal Pre-trained mode...

7 Haoyang Huang, et al. ∙

research

∙ 04/02/2020

Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers

We propose Pixel-BERT to align image pixels with text by deep multi-moda...

0 Zhicheng Huang, et al. ∙

research

∙ 12/08/2019

Learning Sparse 2D Temporal Adjacent Networks for Temporal Action Localization

In this report, we introduce the Winner method for HACS Temporal Action ...

0 Houwen Peng, et al. ∙

research

∙ 12/08/2019

Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Language

We address the problem of retrieving a specific moment from an untrimmed...

0 Houwen Peng, et al. ∙

research

∙ 11/24/2019

Neural Storyboard Artist: Visualizing Stories with Coherent Image Sequences

A storyboard is a sequence of images to illustrate a story containing mu...

0 Shizhe Chen, et al. ∙

research

∙ 11/09/2019

Learning Deep Bilinear Transformation for Fine-grained Image Representation

Bilinear feature transformation has shown the state-of-the-art performan...

0 Heliang Zheng, et al. ∙

research

∙ 10/29/2019

Learning Rich Image Region Representation for Visual Question Answering

We propose to boost VQA by leveraging more powerful feature extractors b...

0 Bei Liu, et al. ∙

research

∙ 10/03/2019

360-Indoor: Towards Learning Real-World Objects in 360° Indoor Equirectangular Images

While there are several widely used object detection datasets, current c...

46 Shih-Han Chou, et al. ∙

research

∙ 09/11/2019

WSOD^2: Learning Bottom-up and Top-down Objectness Distillation for Weakly-supervised Object Detection

We study on weakly-supervised object detection (WSOD) which plays a vita...

0 Zhaoyang Zeng, et al. ∙

research

∙ 07/29/2019

Learn to Scale: Generating Multipolar Normalized Density Map for Crowd Counting

Dense crowd counting aims to predict thousands of human instances from a...

3 Chenfeng Xu, et al. ∙

research

∙ 07/29/2019

Learn to Scale: Generating Multipolar Normalized Density Maps for Crowd Counting

Dense crowd counting aims to predict thousands of human instances from a...

0 Chenfeng Xu, et al. ∙

research

∙ 07/11/2019

Activitynet 2019 Task 3: Exploring Contexts for Dense Captioning Events in Videos

Contextual reasoning is essential to understand events in long untrimmed...

0 Shizhe Chen, et al. ∙

research

∙ 06/03/2019

From Words to Sentences: A Progressive Learning Approach for Zero-resource Machine Translation with Visual Pivots

The neural machine translation model has suffered from the lack of large...

0 Shizhe Chen, et al. ∙

research

∙ 04/16/2019

Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting

High-quality image inpainting requires filling missing regions in a dama...

32 Yanhong Zeng, et al. ∙

research

∙ 03/14/2019

Looking for the Devil in the Details: Learning Trilinear Attention Sampling Network for Fine-grained Image Recognition

Learning subtle yet discriminative features (e.g., beak and eyes for a b...

0 Heliang Zheng, et al. ∙

research

∙ 08/09/2018

Image Inspired Poetry Generation in XiaoIce

Vision is a common source of inspiration for poetry. The objects and the...

0 Wen-Feng Cheng, et al. ∙

research

∙ 04/23/2018

Beyond Narrative Description: Generating Poetry from Images by Multi-Adversarial Training

Automatic generation of natural language from images has attracted exten...

0 Bei Liu, et al. ∙

research

∙ 02/18/2018

DA-GAN: Instance-level Image Translation by Deep Attention Generative Adversarial Networks (with Supplementary Materials)

Unsupervised image translation, which aims in translating two independen...

0 Shuang Ma, et al. ∙

research

∙ 01/27/2018

Tell-and-Answer: Towards Explainable Visual Question Answering using Attributes and Captions

Visual Question Answering (VQA) has attracted attention from both comput...

0 Qing Li, et al. ∙

research

∙ 11/23/2017

Self-view Grounding Given a Narrated 360° Video

Narrated 360 videos are typically provided in many touring scenarios to ...

0 Shih-Han Chou, et al. ∙

research

∙ 05/02/2017

Show, Adapt and Tell: Adversarial Training of Cross-domain Image Captioner

Impressive image captioning results are achieved in domains with plenty ...

0 Tseng-Hung Chen, et al. ∙

research

∙ 06/02/2016

Storytelling of Photo Stream with Bidirectional Multi-thread Recurrent Neural Network

Visual storytelling aims to generate human-level narrative language (i.e...

0 Yu Liu, et al. ∙

Jianlong Fu

Featured Co-authors