b'Jun-Yan Zhu'

research

∙ 05/04/2023

Controllable Visual-Tactile Synthesis

Deep generative models have various content creation applications such a...

0 Ruihan Gao, et al. ∙

research

∙ 05/02/2023

Generalizing Dataset Distillation via Deep Generative Prior

Dataset Distillation aims to distill an entire dataset's knowledge into ...

0 George Cazenavette, et al. ∙

research

∙ 04/24/2023

Total-Recon: Deformable Scene Reconstruction for Embodied View Synthesis

We explore the task of embodied view synthesis from monocular videos of ...

0 Chonghyuk Song, et al. ∙

research

∙ 04/13/2023

Expressive Text-to-Image Generation with Rich Text

Plain text has become a prevalent interface for text-to-image synthesis....

0 Songwei Ge, et al. ∙

research

∙ 03/23/2023

Ablating Concepts in Text-to-Image Diffusion Models

Large-scale text-to-image diffusion models can generate high-fidelity im...

0 Nupur Kumari, et al. ∙

research

∙ 02/16/2023

3D-aware Conditional Image Synthesis

We propose pix2pix3D, a 3D-aware conditional generative model for contro...

0 Kangle Deng, et al. ∙

research

∙ 02/13/2023

3D-aware Blending with Generative NeRFs

Image blending aims to combine multiple images seamlessly. It remains ch...

0 Hyunsu Kim, et al. ∙

research

∙ 02/06/2023

Zero-shot Image-to-Image Translation

Large-scale text-to-image generative models have shown their remarkable ...

0 Gaurav Parmar, et al. ∙

research

∙ 01/12/2023

Domain Expansion of Image Generators

Can one inject new concepts into an already trained generative model, wh...

0 Yotam Nitzan, et al. ∙

research

∙ 12/08/2022

Multi-Concept Customization of Text-to-Image Diffusion

While generative models produce high-quality images of concepts learned ...

0 Nupur Kumari, et al. ∙

research

∙ 11/03/2022

Efficient Spatially Sparse Inference for Conditional GANs and Diffusion Models

During image editing, existing deep generative models tend to re-synthes...

6 Muyang Li, et al. ∙

research

∙ 10/06/2022

Content-Based Search for Deep Generative Models

The growing proliferation of pretrained generative models has made it in...

40 Daohan Lu, et al. ∙

research

∙ 07/28/2022

Rewriting Geometric Rules of a GAN

Deep generative models make visual content creation more accessible to n...

39 Sheng-Yu Wang, et al. ∙

research

∙ 06/16/2022

Spatially-Adaptive Multilayer Selection for GAN Inversion and Editing

Existing GAN inversion and editing methods work well for aligned objects...

0 Gaurav Parmar, et al. ∙

research

∙ 03/22/2022

Dataset Distillation by Matching Training Trajectories

Dataset distillation is the task of synthesizing a small dataset such th...

16 George Cazenavette, et al. ∙

research

∙ 12/16/2021

Ensembling Off-the-shelf Models for GAN Training

The advent of large-scale training has produced a cornucopia of powerful...

6 Nupur Kumari, et al. ∙

research

∙ 12/09/2021

GAN-Supervised Dense Visual Alignment

We propose GAN-Supervised Learning, a framework for learning discriminat...

7 William Peebles, et al. ∙

research

∙ 11/12/2021

Contrastive Feature Loss for Image Prediction

Training supervised image synthesis models requires a critic to compare ...

0 Alex Andonian, et al. ∙

research

∙ 08/05/2021

Sketch Your Own GAN

Can a user create a deep generative model by sketching a single example?...

14 Sheng-Yu Wang, et al. ∙

research

∙ 07/06/2021

Depth-supervised NeRF: Fewer Views and Faster Training for Free

One common failure mode of Neural Radiance Field (NeRF) models is fittin...

16 Kangle Deng, et al. ∙

research

∙ 05/13/2021

Editing Conditional Radiance Fields

A neural radiance field (NeRF) is a scene model supporting high-quality ...

0 Steven Liu, et al. ∙

research

∙ 04/29/2021

Ensembling with Deep Generative Views

Recent generative models can synthesize "views" of artificial images tha...

7 Lucy Chai, et al. ∙

research

∙ 04/22/2021

On Buggy Resizing Libraries and Surprising Subtleties in FID Calculation

We investigate the sensitivity of the Fréchet Inception Distance (FID) s...

9 Gaurav Parmar, et al. ∙

research

∙ 03/04/2021

Anycost GANs for Interactive Image Synthesis and Editing

Generative adversarial networks (GANs) have enabled photorealistic image...

23 Ji Lin, et al. ∙

research

∙ 09/10/2020

Understanding the Role of Individual Units in a Deep Neural Network

Deep neural networks excel at finding hierarchical representations that ...

11 David Bau, et al. ∙

research

∙ 08/24/2020

The Hessian Penalty: A Weak Prior for Unsupervised Disentanglement

Existing disentanglement methods for deep generative models rely on hand...

9 William Peebles, et al. ∙

research

∙ 07/30/2020

Contrastive Learning for Unpaired Image-to-Image Translation

In image-to-image translation, each patch in the output should reflect t...

1 Taesung Park, et al. ∙

research

∙ 07/30/2020

Rewriting a Deep Generative Model

A deep generative model such as a GAN learns to model a rich set of sema...

12 David Bau, et al. ∙

research

∙ 07/01/2020

Swapping Autoencoder for Deep Image Manipulation

Deep generative models have become increasingly effective at producing r...

2 Taesung Park, et al. ∙

research

∙ 06/18/2020

Differentiable Augmentation for Data-Efficient GAN Training

The performance of generative adversarial networks (GANs) heavily deteri...

11 Shengyu Zhao, et al. ∙

research

∙ 06/18/2020

Diverse Image Generation via Self-Conditioned GANs

We introduce a simple but effective unsupervised method for generating r...

12 Steven Liu, et al. ∙

research

∙ 05/15/2020

Semantic Photo Manipulation with a Generative Image Prior

Despite the recent success of GANs in synthesizing images conditioned on...

21 David Bau, et al. ∙

research

∙ 05/04/2020

Transforming and Projecting Images into Class-conditional Generative Networks

We present a method for projecting an input image into the space of a cl...

1 Minyoung Huh, et al. ∙

research

∙ 04/08/2020

State of the Art on Neural Rendering

Efficient rendering of photo-realistic virtual worlds is a long standing...

13 Ayush Tewari, et al. ∙

research

∙ 03/19/2020

GAN Compression: Efficient Architectures for Interactive Conditional GANs

Conditional Generative Adversarial Networks (cGANs) have enabled control...

69 Muyang Li, et al. ∙

research

∙ 10/24/2019

Seeing What a GAN Cannot Generate

Despite the success of Generative Adversarial Networks (GANs), mode coll...

53 David Bau, et al. ∙

research

∙ 06/14/2019

Connecting Touch and Vision via Cross-Modal Prediction

Humans perceive the world using multi-modal sensory inputs such as visio...

4 Yunzhu Li, et al. ∙

research

∙ 03/18/2019

Semantic Image Synthesis with Spatially-Adaptive Normalization

We propose spatially-adaptive normalization, a simple but effective laye...

62 Taesung Park, et al. ∙

research

∙ 01/29/2019

Visualizing and Understanding Generative Adversarial Networks (Extended Abstract)

Generative Adversarial Networks (GANs) have achieved impressive results ...

22 David Bau, et al. ∙

research

∙ 12/06/2018

Visual Object Networks: Image Generation with Disentangled 3D Representation

Recent progress in deep generative models has led to tremendous breakthr...

8 Jun-Yan Zhu, et al. ∙

research

∙ 11/27/2018

Dataset Distillation

Model distillation aims to distill the knowledge of a complex model into...

3 Tongzhou Wang, et al. ∙

research

∙ 11/26/2018

GAN Dissection: Visualizing and Understanding Generative Adversarial Networks

Generative Adversarial Networks (GANs) have recently achieved impressive...

10 David Bau, et al. ∙

research

∙ 09/28/2018

Propagation Networks for Model-Based Control Under Partial Observation

There has been an increasing interest in learning dynamics simulators fo...

4 Yunzhu Li, et al. ∙

research

∙ 08/28/2018

3D-Aware Scene Manipulation via Inverse Graphics

We aim to obtain an interpretable, expressive and disentangled scene rep...

0 Shunyu Yao, et al. ∙

research

∙ 08/20/2018

Video-to-Video Synthesis

We study the problem of video-to-video synthesis, whose goal is to learn...

4 Ting-Chun Wang, et al. ∙

research

∙ 01/08/2018

Spatially transformed adversarial examples

Recent studies show that widely used deep neural networks (DNNs) are vul...

0 Chaowei Xiao, et al. ∙

research

∙ 01/08/2018

Generating adversarial examples with adversarial networks

Deep neural networks (DNNs) have been found to be vulnerable to adversar...

0 Chaowei Xiao, et al. ∙

research

∙ 11/30/2017

Toward Multimodal Image-to-Image Translation

Many image-to-image translation problems are ambiguous, as a single inpu...

0 Jun-Yan Zhu, et al. ∙

research

∙ 11/30/2017

High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs

We present a new method for synthesizing high-resolution photo-realistic...

0 Ting-Chun Wang, et al. ∙

research

∙ 11/08/2017

CyCADA: Cycle-Consistent Adversarial Domain Adaptation

Domain adaptation is critical for success in new, unseen environments. A...

0 Judy Hoffman, et al. ∙

Jun-Yan Zhu

Featured Co-authors