Alexander G. Schwing

research

∙ 10/18/2022

CEIP: Combining Explicit and Implicit Priors for Reinforcement Learning with Demonstrations

Although reinforcement learning has found widespread use in dense reward...

0 Kai Yan, et al. ∙

research

∙ 10/14/2022

Learnable Polyphase Sampling for Shift Invariant and Equivariant Convolutional Networks

We propose learnable polyphase sampling (LPS), a pair of learnable down/...

0 Renan A. Rojas-Gomez, et al. ∙

research

∙ 10/11/2022

Controllable Radiance Fields for Dynamic Face Synthesis

Recent work on 3D-aware image synthesis has achieved compelling results ...

0 Peiye Zhuang, et al. ∙

research

∙ 10/09/2022

Learning to Decompose Visual Features with Latent Textual Prompts

Recent advances in pre-training vision-language models like CLIP have sh...

0 Feng Wang, et al. ∙

research

∙ 08/04/2022

Occupancy Planes for Single-view RGB-D Human Reconstruction

Single-view RGB-D human reconstruction with implicit functions is often ...

0 Xiaoming Zhao, et al. ∙

research

∙ 07/28/2022

Initialization and Alignment for Adversarial Texture Optimization

While recovery of geometry from image and video data has received a lot ...

0 Xiaoming Zhao, et al. ∙

research

∙ 07/14/2022

XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model

We present XMem, a video object segmentation architecture for long video...

0 Ho Kei Cheng, et al. ∙

research

∙ 05/30/2022

Neural Volumetric Object Selection

We introduce an approach for selecting objects in neural volumetric 3D r...

0 Zhongzheng Ren, et al. ∙

research

∙ 05/12/2022

Asking for Knowledge: Training RL Agents to Query External Knowledge Using Language

To solve difficult tasks, humans ask questions to acquire knowledge from...

13 Iou-Jen Liu, et al. ∙

research

∙ 04/07/2022

Total Variation Optimization Layers for Computer Vision

Optimization within a layer of a deep-net has emerged as a new direction...

0 Raymond A. Yeh, et al. ∙

research

∙ 04/07/2022

Equivariance Discovery by Learned Parameter-Sharing

Designing equivariance as an inductive bias into deep-nets has been a pr...

0 Raymond A. Yeh, et al. ∙

research

∙ 12/20/2021

Mask2Former for Video Instance Segmentation

We find Mask2Former also achieves state-of-the-art performance on video ...

11 Bowen Cheng, et al. ∙

research

∙ 12/03/2021

Class-agnostic Reconstruction of Dynamic Objects from Videos

We introduce REDO, a class-agnostic framework to REconstruct the Dynamic...

0 Zhongzheng Ren, et al. ∙

research

∙ 12/02/2021

Masked-attention Mask Transformer for Universal Image Segmentation

Image segmentation is about grouping pixels with different semantics, e....

6 Bowen Cheng, et al. ∙

research

∙ 08/06/2021

Semantic Tracklets: An Object-Centric Representation for Visual Multi-Agent Reinforcement Learning

Solving complex real-world tasks, e.g., autonomous fleet control, often ...

0 Iou-Jen Liu, et al. ∙

research

∙ 07/23/2021

Cooperative Exploration for Multi-Agent Deep Reinforcement Learning

Exploration is critical for good results in deep reinforcement learning ...

0 Iou-Jen Liu, et al. ∙

research

∙ 07/13/2021

Per-Pixel Classification is Not All You Need for Semantic Segmentation

Modern approaches typically formulate semantic segmentation as a per-pix...

6 Bowen Cheng, et al. ∙

research

∙ 05/31/2021

Robustifying ℓ_∞ Adversarial Training to the Union of Perturbation Models

Classical adversarial training (AT) frameworks are designed to achieve h...

0 Ameya D. Patil, et al. ∙

research

∙ 05/18/2021

SAIL-VOS 3D: A Synthetic Dataset and Baselines for Object Detection and 3D Mesh Reconstruction from Video Data

Extracting detailed 3D information of objects from video data is an impo...

0 Yuan-Ting Hu, et al. ∙

research

∙ 05/13/2021

3D Spatial Recognition without Spatially Labeled 3D

We introduce WyPR, a Weakly-supervised framework for Point cloud Recogni...

0 Zhongzheng Ren, et al. ∙

research

∙ 05/13/2021

DeepQAMVS: Query-Aware Hierarchical Pointer Networks for Multi-Video Summarization

The recent growth of web video sharing platforms has increased the deman...

7 Safa Messaoud, et al. ∙

research

∙ 02/01/2021

Enjoy Your Editing: Controllable GANs for Image Editing via Latent Space Navigation

Controllable semantic image editing enables a user to change entire imag...

10 Peiye Zhuang, et al. ∙

research

∙ 12/17/2020

High-Throughput Synchronous Deep RL

Deep reinforcement learning (RL) is computationally demanding and requir...

0 Iou-Jen Liu, et al. ∙

research

∙ 10/21/2020

UFO^2: A Unified Framework towards Omni-supervised Object Detection

Existing work on object detection often relies on a single form of annot...

0 Zhongzheng Ren, et al. ∙

research

∙ 07/02/2020

Not All Unlabeled Data are Equal: Learning to Weight Data in Semi-supervised Learning

Existing semi-supervised learning (SSL) algorithms use a single weight t...

0 Zhongzheng Ren, et al. ∙

research

∙ 04/27/2020

Can We Learn Heuristics For Graphical Model Inference Using Reinforcement Learning?

Combinatorial optimization is frequently used in computer vision. For in...

4 Safa Messaoud, et al. ∙

research

∙ 04/09/2020

Instance-aware, Context-focused, and Memory-efficient Weakly Supervised Object Detection

Weakly supervised learning has emerged as a compelling tool for object d...

2 Zhongzheng Ren, et al. ∙

research

∙ 10/31/2019

Chirality Nets for Human Pose Regression

We propose Chirality Nets, a family of deep nets that is equivariant to ...

10 Raymond A. Yeh, et al. ∙

research

∙ 10/31/2019

PIC: Permutation Invariant Critic for Multi-Agent Deep Reinforcement Learning

Sample efficiency and scalability to a large number of agents are two im...

0 Iou-Jen Liu, et al. ∙

research

∙ 10/31/2019

Co-Generation with GANs using AIS based HMC

Inferring the most likely configuration for a subset of variables of a j...

16 Tiantian Fang, et al. ∙

research

∙ 10/31/2019

TAB-VCR: Tags and Attributes based VCR Baselines

Reasoning is an important ability that we learn from a very early age. Y...

3 Jingxiang Lin, et al. ∙

research

∙ 07/13/2019

FMRI data augmentation via synthesis

We present an empirical evaluation of fMRI data augmentation via synthes...

0 Peiye Zhuang, et al. ∙

research

∙ 04/11/2019

Knowledge Flow: Improve Upon Your Teachers

A zoo of deep nets is available these days for almost any given task, an...

18 Iou-Jen Liu, et al. ∙

research

∙ 11/01/2018

Out of the Box: Reasoning with Graph Convolution Nets for Factual Visual Question Answering

Accurately answering a question about a given image requires combining o...

10 Medhini Narasimhan, et al. ∙

research

∙ 09/06/2018

Structural Consistency and Controllability for Diverse Colorization

Colorizing a given gray-level image is an important task in the media an...

2 Safa Messaoud, et al. ∙

research

∙ 09/04/2018

Straight to the Facts: Learning Knowledge Base Retrieval for Factual Visual Question Answering

Question answering is an important task for autonomous agents and virtua...

2 Medhini Narasimhan, et al. ∙

research

∙ 09/04/2018

Unsupervised Video Object Segmentation using Motion Saliency-Guided Spatio-Temporal Propagation

Unsupervised video segmentation plays an important role in a wide variet...

0 Yuan-Ting Hu, et al. ∙

research

∙ 09/04/2018

VideoMatch: Matching based Video Object Segmentation

Video object segmentation is challenging yet important in a wide variety...

6 Yuan-Ting Hu, et al. ∙

research

∙ 09/03/2018

Diverse and Coherent Paragraph Generation from Images

Paragraph generation from images, which has gained popularity recently, ...

0 Moitreya Chatterjee, et al. ∙

research

∙ 03/29/2018

Interpretable and Globally Optimal Prediction for Textual Grounding using Image Concepts

Textual grounding is an important but challenging task for human-compute...

0 Raymond A. Yeh, et al. ∙

research

∙ 03/29/2018

MaskRNN: Instance Level Video Object Segmentation

Instance level video object segmentation is an important technique for v...

0 Yuan-Ting Hu, et al. ∙

research

∙ 03/29/2018

Unsupervised Textual Grounding: Linking Words to Image Concepts

Textual grounding, i.e., linking words to objects in images, is a challe...

2 Raymond A. Yeh, et al. ∙

research

∙ 11/19/2017

Diverse and Accurate Image Description Using a Variational Auto-Encoder with an Additive Gaussian Encoding Space

This paper explores image caption generation using conditional variation...

0 Liwei Wang, et al. ∙

research

∙ 11/12/2017

High-Order Attention Models for Visual Question Answering

The quest for algorithms that enable cognitive abilities is an important...

0 Idan Schwartz, et al. ∙

research

∙ 11/05/2016

Learning to Play in a Day: Faster Deep Reinforcement Learning by Optimality Tightening

We propose a novel training algorithm for reinforcement learning which c...

0 Frank S. He, et al. ∙

research

∙ 07/26/2016

Semantic Image Inpainting with Deep Generative Models

Semantic image inpainting is a challenging task where large missing regi...

0 Raymond A. Yeh, et al. ∙

research

∙ 05/12/2015

Monocular Object Instance Segmentation and Depth Ordering with CNNs

In this paper we tackle the problem of instance-level segmentation and d...

0 Ziyu Zhang, et al. ∙

research

∙ 03/09/2015

Fully Connected Deep Structured Networks

Convolutional neural networks with many layers have recently been shown ...

0 Alexander G. Schwing, et al. ∙

Alexander G. Schwing

Featured Co-authors