b'Chenliang Xu'

research

∙ 05/15/2023

Training Neural Networks without Backpropagation: A Deeper Dive into the Likelihood Ratio Method

Backpropagation (BP) is the most important gradient estimation method fo...

0 Jinyang Jiang, et al. ∙

research

∙ 03/23/2023

Egocentric Audio-Visual Object Localization

Humans naturally perceive surrounding scenes by unifying sound and sight...

0 Chao Huang, et al. ∙

research

∙ 02/04/2023

AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis

Human perception of the complex world relies on a comprehensive analysis...

0 Susan Liang, et al. ∙

research

∙ 01/30/2023

Improving Adversarial Transferability with Scheduled Step Size and Dual Example

Deep neural networks are widely known to be vulnerable to adversarial ex...

0 Zeliang Zhang, et al. ∙

research

∙ 12/09/2022

A Whac-A-Mole Dilemma: Shortcuts Come in Multiples Where Mitigating One Amplifies Others

Machine learning models have been found to learn shortcuts – unintended ...

14 Zhiheng Li, et al. ∙

research

∙ 07/20/2022

Discover and Mitigate Unknown Biases with Debiasing Alternate Networks

Deep image classifiers have been found to learn biases from datasets. To...

0 Zhiheng Li, et al. ∙

research

∙ 03/29/2022

StyleT2I: Toward Compositional and High-Fidelity Text-to-Image Synthesis

Although progress has been made for text-to-image synthesis, previous me...

0 Zhiheng Li, et al. ∙

research

∙ 03/26/2022

Learning to Answer Questions in Dynamic Audio-Visual Scenarios

In this paper, we focus on the Audio-Visual Question Answering (AVQA) ta...

10 Guangyao Li, et al. ∙

research

∙ 03/26/2022

Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolution

Magnetic resonance imaging (MRI) can present multi-contrast images of th...

11 Guangyuan Li, et al. ∙

research

∙ 01/18/2022

Cross-modal Contrastive Distillation for Instructional Activity Anticipation

In this study, we aim to predict the plausible future action steps given...

0 Zhengyuan Yang, et al. ∙

research

∙ 12/12/2021

Anomaly Crossing: A New Method for Video Anomaly Detection as Cross-domain Few-shot Learning

Video anomaly detection aims to identify abnormal events that occurred i...

0 Guangyu Sun, et al. ∙

research

∙ 11/30/2021

SpaceEdit: Learning a Unified Editing Space for Open-Domain Image Editing

Recently, large pretrained models (e.g., BERT, StyleGAN, CLIP) have show...

1 Jing Shi, et al. ∙

research

∙ 11/10/2021

Space-Time Memory Network for Sounding Object Localization in Videos

Leveraging temporal synchronization and association within sight and sou...

12 Sizhe Li, et al. ∙

research

∙ 10/05/2021

Procedure Planning in Instructional Videosvia Contextual Modeling and Model-based Policy Learning

Learning new skills by observing humans' behaviors is an essential capab...

0 Jing Bi, et al. ∙

research

∙ 09/06/2021

Learning to Generate Scene Graph from Natural Language Supervision

Learning from image-text data has demonstrated recent success for many r...

4 Yiwu Zhong, et al. ∙

research

∙ 06/24/2021

Learning by Planning: Language-Guided Global Image Editing

Recently, language-guided global image editing draws increasing attentio...

0 Jing Shi, et al. ∙

research

∙ 04/29/2021

Discover the Unknown Biased Attribute of an Image Classifier

Recent works find that AI algorithms learn biases from data. Therefore, ...

2 Zhiheng Li, et al. ∙

research

∙ 04/15/2021

Zooming SlowMo: An Efficient One-Stage Framework for Space-Time Video Super-Resolution

In this paper, we address the space-time video super-resolution, which a...

11 Xiaoyu Xiang, et al. ∙

research

∙ 04/05/2021

Cyclic Co-Learning of Sounding Object Visual Grounding and Sound Separation

There are rich synchronized audio and visual events in our daily life. I...

0 Yapeng Tian, et al. ∙

research

∙ 04/05/2021

Can audio-visual integration strengthen robustness under multimodal attacks?

In this paper, we propose to make a systematic study on machines multise...

0 Yapeng Tian, et al. ∙

research

∙ 03/29/2021

High-fidelity Face Tracking for AR/VR via Deep Lighting Adaptation

3D video avatars can empower virtual communications by providing compres...

0 Lele Chen, et al. ∙

research

∙ 10/05/2020

A Benchmark and Baseline for Language-Driven Image Editing

Language-driven image editing can significantly save the laborious image...

6 Jing Shi, et al. ∙

research

∙ 10/03/2020

Cubic Spline Smoothing Compensation for Irregularly Sampled Sequences

The marriage of recurrent neural networks and neural ordinary differenti...

7 Jing Shi, et al. ∙

research

∙ 07/21/2020

Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing

In this paper, we introduce a new problem, named audio-visual video pars...

3 Yapeng Tian, et al. ∙

research

∙ 07/16/2020

Talking-head Generation with Rhythmic Head Motion

When people deliver a speech, they naturally move heads, and this rhythm...

3 Lele Chen, et al. ∙

research

∙ 06/12/2020

Explaining Local, Global, And Higher-Order Interactions In Deep Learning

We present a simple yet highly generalizable method for explaining inter...

26 Samuel Lerman, et al. ∙

research

∙ 05/07/2020

What comprises a good talking-head video generation?: A Survey and Benchmark

Over the years, performance evaluation has become essential in computer ...

6 Lele Chen, et al. ∙

research

∙ 03/29/2020

Learning a Weakly-Supervised Video Actor-Action Segmentation Model with a Wise Selection

We address weakly-supervised video actor-action segmentation (VAAS), whi...

20 Jie Chen, et al. ∙

research

∙ 03/25/2020

Deep Grouping Model for Unified Perceptual Parsing

The perceptual-based grouping process produces a hierarchical and compos...

5 Zhiheng Li, et al. ∙

research

∙ 02/26/2020

Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolution

In this paper, we explore the space-time video super-resolution task, wh...

20 Xiaoyu Xiang, et al. ∙

research

∙ 02/23/2020

Assembling Semantically-Disentangled Representations for Predictive-Generative Models via Adaptation from Synthetic Domain

Deep neural networks can form high-level hierarchical representations of...

3 Burkay Donderici, et al. ∙

research

∙ 12/21/2019

Deep Audio Prior

Deep convolutional neural networks are known to specialize in distilling...

12 Yapeng Tian, et al. ∙

research

∙ 12/04/2019

Learning from Interventions using Hierarchical Policies for Safe Learning

Learning from Demonstrations (LfD) via Behavior Cloning (BC) works well ...

6 Jing Bi, et al. ∙

research

∙ 11/17/2019

Weakly Supervised Object Localization with Inter-Intra Regulated CAMs

Weakly supervised object localization (WSOL) aims to locate objects in i...

9 Guofeng Cui, et al. ∙

research

∙ 09/30/2019

Unsupervised Pose Flow Learning for Pose Guided Synthesis

Pose guided synthesis aims to generate a new image in an arbitrary targe...

30 Haitian Zheng, et al. ∙

research

∙ 05/09/2019

Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Loss

We devise a cascade GAN approach to generate talking face video, which i...

8 Lele Chen, et al. ∙

research

∙ 12/13/2018

Dynamic Graph Modules for Modeling Higher-Order Interactions in Activity Recognition

Video action recognition, as a critical problem towards video understand...

4 Hao Huang, et al. ∙

research

∙ 12/07/2018

TDAN: Temporally Deformable Alignment Network for Video Super-Resolution

Video super-resolution (VSR) aims to restore a photo-realistic high-reso...

10 Yapeng Tian, et al. ∙

research

∙ 12/07/2018

An Attempt towards Interpretable Audio-Visual Video Captioning

Automatically generating a natural language sentence to describe the con...

10 Yapeng Tian, et al. ∙

research

∙ 12/02/2018

How to Make a BLT Sandwich? Learning to Reason towards Understanding Web Instructional Videos

Understanding web instructional videos is an essential branch of video u...

0 Shaojie Wang, et al. ∙

research

∙ 12/02/2018

GAN-EM: GAN based EM learning framework

Expectation maximization (EM) algorithm is to find maximum likelihood so...

0 Wentian Zhao, et al. ∙

research

∙ 11/01/2018

Navigation by Imitation in a Pedestrian-Rich Environment

Deep neural networks trained on demonstrations of human actions give rob...

2 Jing Bi, et al. ∙

research

∙ 03/28/2018

Weakly-Supervised Action Segmentation with Iterative Soft Boundary Assignment

In this work, we address the task of weakly-supervised human action segm...

0 Li Ding, et al. ∙

research

∙ 03/28/2018

Lip Movements Generation at a Glance

Cross-modality generation is an emerging topic that aims to synthesize d...

0 Lele Chen, et al. ∙

research

∙ 03/26/2018

Generating Talking Face Landmarks from Speech

The presence of a corresponding talking face has been shown to significa...

0 Sefik Emre Eskimez, et al. ∙

research

∙ 03/23/2018

Audio-Visual Event Localization in Unconstrained Videos

In this paper, we introduce a novel problem of audio-visual event locali...

0 Yapeng Tian, et al. ∙

research

∙ 05/22/2017

TricorNet: A Hybrid Temporal Convolutional and Recurrent Network for Video Action Segmentation

Action segmentation as a milestone towards building automatic systems to...

0 Li Ding, et al. ∙

research

∙ 04/26/2017

Deep Cross-Modal Audio-Visual Generation

Cross-modal audio-visual perception has been a long-lasting topic in psy...

0 Lele Chen, et al. ∙

research

∙ 03/28/2017

Towards Automatic Learning of Procedures from Web Instructional Videos

The potential for agents, whether embodied or software, to learn by obse...

0 Luowei Zhou, et al. ∙

research

∙ 06/15/2016

Watch What You Just Said: Image Captioning with Text-Conditional Attention

Attention mechanisms have attracted considerable interest in image capti...

0 Luowei Zhou, et al. ∙

Chenliang Xu

Featured Co-authors