b'Ziwei Liu'

research

∙ 05/22/2023

RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatars

Synthesizing high-fidelity head avatars is a central problem for compute...

3 Dongwei Pan, et al. ∙

research

∙ 05/18/2023

ConsistentNeRF: Enhancing Neural Radiance Fields with 3D Consistency for Sparse View Synthesis

Neural Radiance Fields (NeRF) has demonstrated remarkable 3D reconstruct...

0 Shoukang Hu, et al. ∙

research

∙ 05/09/2023

StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generator

Despite recent advances in syncing lip movements with any audio waves, c...

0 Jiazhi Guan, et al. ∙

research

∙ 05/05/2023

Otter: A Multi-Modal Model with In-Context Instruction Tuning

Large language models (LLMs) have demonstrated significant universal cap...

0 Bo Li, et al. ∙

research

∙ 04/20/2023

Collaborative Diffusion for Multi-Modal Face Generation and Editing

Diffusion models arise as a powerful generative tool recently. Despite t...

10 Ziqi Huang, et al. ∙

research

∙ 04/19/2023

Transformer-Based Visual Segmentation: A Survey

Visual segmentation seeks to partition images, video frames, or point cl...

24 Xiangtai Li, et al. ∙

research

∙ 04/18/2023

Variational Relational Point Completion Network for Robust 3D Classification

Real-scanned point clouds are often incomplete due to viewpoint, occlusi...

0 Liang Pan, et al. ∙

research

∙ 04/17/2023

Text2Performer: Text-Driven Human Video Generation

Text-driven content creation has evolved to be a transformative techniqu...

0 Yuming Jiang, et al. ∙

research

∙ 04/13/2023

RoboBEV: Towards Robust Bird's Eye View Perception under Corruptions

The recent advances in camera-based bird's eye view (BEV) representation...

10 Shaoyuan Xie, et al. ∙

research

∙ 04/06/2023

DiffMimic: Efficient Motion Mimicking with Differentiable Physics

Motion mimicking is a foundational task in physics-based character anima...

4 Jiawei Ren, et al. ∙

research

∙ 04/05/2023

Detecting and Grounding Multi-Modal Media Manipulation

Misinformation has become a pressing issue. Fake media, in both visual a...

0 Rui Shao, et al. ∙

research

∙ 03/30/2023

Robo3D: Towards Robust and Reliable 3D Perception against Corruptions

The robustness of 3D perception systems under natural corruptions from e...

10 Lingdong Kong, et al. ∙

research

∙ 03/30/2023

SynBody: Synthetic Dataset with Layered Human Models for 3D Human Perception and Modeling

Synthetic data has emerged as a promising source for 3D human research a...

1 Zhitao Yang, et al. ∙

research

∙ 03/28/2023

SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesis

Neural Radiance Field (NeRF) significantly degrades when only a limited ...

0 Guangcong Wang, et al. ∙

research

∙ 03/28/2023

F^2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectories

This paper presents a novel grid-based NeRF called F2-NeRF (Fast-Free-Ne...

0 Peng Wang, et al. ∙

research

∙ 03/23/2023

ReVersion: Diffusion-Based Relation Inversion from Images

Diffusion models gain increasing popularity for their generative capabil...

2 Ziqi Huang, et al. ∙

research

∙ 03/23/2023

A Simple and Generic Framework for Feature Distillation via Channel-wise Transformation

Knowledge distillation is a popular technique for transferring the knowl...

0 Ziwei Liu, et al. ∙

research

∙ 03/22/2023

SHERF: Generalizable Human NeRF from a Single Image

Existing Human NeRF methods for reconstructing 3D humans typically rely ...

0 Shoukang Hu, et al. ∙

research

∙ 03/16/2023

Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generation

Animating virtual avatars to make co-speech gestures facilitates various...

0 Lingting Zhu, et al. ∙

research

∙ 03/13/2023

Revisiting Class-Incremental Learning with Pre-Trained Models: Generalizability and Adaptivity are All You Need

Class-incremental learning (CIL) aims to adapt to emerging new classes w...

0 Da-Wei Zhou, et al. ∙

research

∙ 03/10/2023

StyleGANEX: StyleGAN-Based Manipulation Beyond Cropped Aligned Faces

Recent advances in face manipulation using StyleGAN have produced impres...

0 Shuai Yang, et al. ∙

research

∙ 03/09/2023

Rethinking Range View Representation for LiDAR Segmentation

LiDAR segmentation is crucial for autonomous driving perception. Recent ...

0 Lingdong Kong, et al. ∙

research

∙ 02/18/2023

A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT

The Pretrained Foundation Models (PFMs) are regarded as the foundation f...

0 Ce Zhou, et al. ∙

research

∙ 02/14/2023

Make Your Brief Stroke Real and Stereoscopic: 3D-Aware Simplified Sketch to Portrait Generation

Creating the photo-realistic version of people sketched portraits is use...

0 Yasheng Sun, et al. ∙

research

∙ 02/07/2023

Deep Class-Incremental Learning: A Survey

Deep models, e.g., CNNs and Vision Transformers, have achieved impressiv...

0 Da-Wei Zhou, et al. ∙

research

∙ 02/02/2023

SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collections

In this work, we present SceneDreamer, an unconditional generative model...

0 Zhaoxi Chen, et al. ∙

research

∙ 01/31/2023

What Makes Good Examples for Visual In-Context Learning?

Large-scale models trained on broad data have recently become the mainst...

0 Yuanhan Zhang, et al. ∙

research

∙ 01/18/2023

OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generation

Recent advances in modeling 3D objects mostly rely on synthetic datasets...

3 Tong Wu, et al. ∙

research

∙ 12/19/2022

Reference-based Image and Video Super-Resolution via C2-Matching

Reference-based Super-Resolution (Ref-SR) has recently emerged as a prom...

0 Yuming Jiang, et al. ∙

research

∙ 12/09/2022

Masked Lip-Sync Prediction by Audio-Visual Contextual Exploitation in Transformers

Previous studies have explored generating accurately lip-synced talking ...

0 Yasheng Sun, et al. ∙

research

∙ 12/05/2022

Audio-Driven Co-Speech Gesture Video Generation

Co-speech gesture is crucial for human-machine interaction and digital e...

3 Xian Liu, et al. ∙

research

∙ 11/10/2022

AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Movies

Existing correspondence datasets for two-dimensional (2D) cartoon suffer...

0 Li Siyao, et al. ∙

research

∙ 10/13/2022

OpenOOD: Benchmarking Generalized Out-of-Distribution Detection

Out-of-distribution (OOD) detection is vital to safety-critical machine ...

0 Jingkang Yang, et al. ∙

research

∙ 10/04/2022

TripleE: Easy Domain Generalization via Episodic Replay

Learning how to generalize the model to unseen domains is an important a...

9 Xiaomeng Li, et al. ∙

research

∙ 09/22/2022

VToonify: Controllable High-Resolution Portrait Video Style Transfer

Generating high-quality artistic portrait videos is an important and des...

12 Shuai Yang, et al. ∙

research

∙ 09/21/2022

Benchmarking and Analyzing 3D Human Pose and Shape Estimation Beyond Algorithms

3D human pose and shape estimation (a.k.a. "human mesh recovery") has ac...

2 Hui En Pang, et al. ∙

research

∙ 09/20/2022

Text2Light: Zero-Shot Text-Driven HDR Panorama Generation

High-quality HDRIs(High Dynamic Range Images), typically HDR panoramas, ...

56 Zhaoxi Chen, et al. ∙

research

∙ 09/15/2022

On-Device Domain Generalization

We present a systematic study of domain generalization (DG) for tiny neu...

30 Kaiyang Zhou, et al. ∙

research

∙ 08/26/2022

Voxurf: Voxel-based Efficient and Accurate Neural Surface Reconstruction

Neural surface reconstruction aims to reconstruct accurate 3D surfaces b...

2 Tong Wu, et al. ∙

research

∙ 08/18/2022

Mind the Gap in Distilling StyleGANs

StyleGAN family is one of the most popular Generative Adversarial Networ...

9 Guodong Xu, et al. ∙

research

∙ 08/17/2022

Open Long-Tailed Recognition in a Dynamic World

Real world data often exhibits a long-tailed and open-ended (with unseen...

5 Ziwei Liu, et al. ∙

research

∙ 08/16/2022

StyleFaceV: Face Video Generation via Decomposing and Recomposing Pretrained StyleGAN3

Realistic generative face video synthesis has long been a pursuit in bot...

9 Haonan Qiu, et al. ∙

research

∙ 08/10/2022

Exploring Point-BEV Fusion for 3D Point Cloud Object Tracking with Transformer

With the prevalence of LiDAR sensors in autonomous driving, 3D object tr...

0 Zhipeng Luo, et al. ∙

research

∙ 07/29/2022

StyleLight: HDR Panorama Generation for Lighting Estimation and Editing

We present a new lighting estimation and editing framework to generate h...

0 Guangcong Wang, et al. ∙

research

∙ 07/27/2022

Multi-Forgery Detection Challenge 2022: Push the Frontier of Unconstrained and Diverse Forgery Detection

In this paper, we present the Multi-Forgery Detection Challenge held con...

2 Jianshu Li, et al. ∙

research

∙ 07/22/2022

Panoptic Scene Graph Generation

Existing research addresses scene graph generation (SGG) – a critical te...

0 Jingkang Yang, et al. ∙

research

∙ 07/20/2022

UNIF: United Neural Implicit Functions for Clothed Human Reconstruction and Animation

We propose united implicit functions (UNIF), a part-based method for clo...

0 Shenhan Qian, et al. ∙

research

∙ 07/14/2022

Benchmarking Omni-Vision Representation through the Lens of Visual Realms

Though impressive performance has been achieved in specific visual realm...

0 Yuanhan Zhang, et al. ∙

research

∙ 07/14/2022

Relighting4D: Neural Relightable Human from Videos

Human relighting is a highly desirable yet challenging task. Existing wo...

0 Zhaoxi Chen, et al. ∙

research

∙ 07/11/2022

Fast-Vid2Vid: Spatial-Temporal Compression for Video-to-Video Synthesis

Video-to-Video synthesis (Vid2Vid) has achieved remarkable results in ge...

0 Long Zhuo, et al. ∙

Ziwei Liu

Featured Co-authors