b'Ying Shan'

research

∙ 09/18/2023

HumTrans: A Novel Open-Source Dataset for Humming Melody Transcription and Beyond

This paper introduces the HumTrans dataset, which is publicly available ...

0 Shansong Liu, et al. ∙

research

∙ 09/18/2023

Unified Pretraining Target Based Video-music Retrieval With Music Rhythm And Video Optical Flow Information

Background music (BGM) can enhance the video's emotion. However, selecti...

0 Tianjun Mao, et al. ∙

research

∙ 09/09/2023

Speech2Lip: High-fidelity Speech to Lip Generation by Learning from a Short Video

Synthesizing realistic videos according to a given speech is still an op...

0 Xiuzhe Wu, et al. ∙

research

∙ 09/04/2023

StyleAdapter: A Single-Pass LoRA-Free Model for Stylized Image Generation

This paper presents a LoRA-free method for stylized image generation tha...

0 Zhouxia Wang, et al. ∙

research

∙ 09/01/2023

Enhancing the vocal range of single-speaker singing voice synthesis with melody-unsupervised pre-training

The single-speaker singing voice synthesis (SVS) usually underperforms a...

0 Shaohuan Zhou, et al. ∙

research

∙ 08/29/2023

Exploring Model Transferability through the Lens of Potential Energy

Transfer learning has become crucial in computer vision tasks due to the...

0 Xiaotong Li, et al. ∙

research

∙ 08/27/2023

Sparse3D: Distilling Multiview-Consistent Diffusion for Object Reconstruction from Sparse Views

Reconstructing 3D objects from extremely sparse views is a long-standing...

0 Zi-Xin Zou, et al. ∙

research

∙ 08/22/2023

Music Understanding LLaMA: Advancing Text-to-Music Generation with Question Answering and Captioning

Text-to-music generation (T2M-Gen) faces a major obstacle due to the sca...

0 Shansong Liu, et al. ∙

research

∙ 08/20/2023

ViT-Lens: Towards Omni-modal Representations

Though the success of CLIP-based training recipes in vision-language mod...

0 Weixian Lei, et al. ∙

research

∙ 08/18/2023

Guide3D: Create 3D Avatars from Text and Image Guidance

Recently, text-to-image generation has exhibited remarkable advancements...

0 Yukang Cao, et al. ∙

research

∙ 08/16/2023

OmniZoomer: Learning to Move and Zoom in on Sphere at High-Resolution

Omnidirectional images (ODIs) have become increasingly popular, as their...

0 Zidong Cao, et al. ∙

research

∙ 07/27/2023

GET3D–: Learning GET3D from Unconstrained Image Collections

The demand for efficient 3D model generation techniques has grown expone...

0 Fanghua Yu, et al. ∙

research

∙ 07/16/2023

Planting a SEED of Vision in Large Language Model

We present SEED, an elaborate image tokenizer that empowers Large Langua...

0 Yuying Ge, et al. ∙

research

∙ 07/11/2023

Neural Point-based Volumetric Avatar: Surface-guided Neural Points for Efficient and Photorealistic Volumetric Head Avatar

Rendering photorealistic and dynamically moving human heads is crucial f...

0 Cong Wang, et al. ∙

research

∙ 07/07/2023

NOFA: NeRF-based One-shot Facial Avatar Reconstruction

3D facial avatar reconstruction has been a significant research topic in...

0 Wangbo Yu, et al. ∙

research

∙ 07/05/2023

DeSRA: Detect and Delete the Artifacts of GAN-based Real-World Super-Resolution Models

Image super-resolution (SR) with generative adversarial networks (GAN) h...

0 Liangbin Xie, et al. ∙

research

∙ 07/05/2023

DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Models

Despite the ability of existing large-scale text-to-image (T2I) models t...

0 Chong Mou, et al. ∙

research

∙ 06/29/2023

ID-Pose: Sparse-view Camera Pose Estimation by Inverting Diffusion Models

Given sparse views of an object, estimating their camera poses is a long...

0 Weihao Cheng, et al. ∙

research

∙ 06/29/2023

DreamDiffusion: Generating High-Quality Images from Brain EEG Signals

This paper introduces DreamDiffusion, a novel method for generating high...

0 Yunpeng Bai, et al. ∙

research

∙ 06/27/2023

On the Universal Adversarial Perturbations for Efficient Data-free Adversarial Detection

Detecting adversarial samples that are carefully crafted to fool the mod...

0 Songyang Gao, et al. ∙

research

∙ 06/27/2023

DSRM: Boost Textual Adversarial Training with Distribution Shift Risk Minimization

Adversarial training is one of the best-performing methods in improving ...

0 Songyang Gao, et al. ∙

research

∙ 06/23/2023

Towards Unseen Triples: Effective Text-Image-joint Learning for Scene Graph Generation

Scene Graph Generation (SGG) aims to structurally and comprehensively re...

0 Qianji Di, et al. ∙

research

∙ 06/22/2023

TaCA: Upgrading Your Visual Foundation Model with Task-agnostic Compatible Adapter

Visual foundation models like CLIP excel in learning feature representat...

0 Binjie Zhang, et al. ∙

research

∙ 06/12/2023

InstructP2P: Learning to Edit 3D Point Clouds with Text Instructions

Enhancing AI systems to perform tasks following human instructions can s...

0 Jiale Xu, et al. ∙

research

∙ 06/12/2023

Sticker820K: Empowering Interactive Retrieval with Stickers

Stickers have become a ubiquitous part of modern-day communication, conv...

7 Sijie Zhao, et al. ∙

research

∙ 06/06/2023

SGAT4PASS: Spherical Geometry-Aware Transformer for PAnoramic Semantic Segmentation

As an important and challenging problem in computer vision, PAnoramic Se...

0 Xuewei Li, et al. ∙

research

∙ 06/01/2023

Make-Your-Video: Customized Video Generation Using Textual and Structural Guidance

Creating a vivid video from the event or scenario in our imagination is ...

0 Jinbo Xing, et al. ∙

research

∙ 06/01/2023

Inserting Anybody in Diffusion Models via Celeb Basis

Exquisite demand exists for customizing the pretrained large text-to-ima...

0 Ge Yuan, et al. ∙

research

∙ 05/29/2023

Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models

Public large-scale text-to-image diffusion models, such as Stable Diffus...

10 Yuchao Gu, et al. ∙

research

∙ 05/23/2023

TVTSv2: Learning Out-of-the-box Spatiotemporal Visual Representations at Scale

The ultimate goal for foundation models is realizing task-agnostic, i.e....

3 Ziyun Zeng, et al. ∙

research

∙ 05/21/2023

A Confidence-based Partial Label Learning Model for Crowd-Annotated Named Entity Recognition

Existing models for named entity recognition (NER) are mainly based on l...

0 Limao Xiong, et al. ∙

research

∙ 05/20/2023

What Makes for Good Visual Tokenizers for Large Language Models?

We empirically investigate proper pre-training methods to build good vis...

0 Guangzhi Wang, et al. ∙

research

∙ 05/11/2023

SparseGNV: Generating Novel Views of Indoor Scenes with Sparse Input Views

We study to generate novel views of indoor scenes given sparse input vie...

0 Weihao Cheng, et al. ∙

research

∙ 04/27/2023

π-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation

Foundation models have achieved great advances in multi-task learning wi...

12 Chengyue Wu, et al. ∙

research

∙ 04/24/2023

HOSNeRF: Dynamic Human-Object-Scene Neural Radiance Fields from a Single Video

We introduce HOSNeRF, a novel 360 free-viewpoint rendering method that r...

0 Jia-Wei Liu, et al. ∙

research

∙ 04/18/2023

SurfelNeRF: Neural Surfel Radiance Fields for Online Photorealistic Reconstruction of Indoor Scenes

Online reconstructing and rendering of large-scale indoor scenes is a lo...

0 Yiming Gao, et al. ∙

research

∙ 04/17/2023

MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editing

Despite the success in large-scale text-to-image generation and text-con...

0 Mingdeng Cao, et al. ∙

research

∙ 04/10/2023

Improved Test-Time Adaptation for Domain Generalization

The main challenge in domain generalization (DG) is to handle the distri...

0 Liang Chen, et al. ∙

research

∙ 04/06/2023

TagGPT: Large Language Models are Zero-shot Multimodal Taggers

Tags are pivotal in facilitating the effective distribution of multimedi...

0 Chen Li, et al. ∙

research

∙ 04/03/2023

DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models

We present DreamAvatar, a text-and-shape guided framework for generating...

0 Yukang Cao, et al. ∙

research

∙ 04/03/2023

Learning Anchor Transformations for 3D Garment Animation

This paper proposes an anchor-based deformation model, namely AnchorDEF,...

0 Fang Zhao, et al. ∙

research

∙ 04/02/2023

DropMAE: Masked Autoencoders with Spatial-Attention Dropout for Tracking Tasks

In this paper, we study masked autoencoder (MAE) pretraining on videos f...

0 Qiangqiang Wu, et al. ∙

research

∙ 03/30/2023

LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation

Recently, diffusion models have achieved great success in image synthesi...

0 Guangcong Zheng, et al. ∙

research

∙ 03/24/2023

Accelerating Vision-Language Pretraining with Free Language Modeling

The state of the arts in vision-language pretraining (VLP) achieves exem...

2 Teng Wang, et al. ∙

research

∙ 03/21/2023

BoPR: Body-aware Part Regressor for Human Shape and Pose Estimation

This paper presents a novel approach for estimating human body shape and...

0 Yongkang Cheng, et al. ∙

research

∙ 03/21/2023

HRDFuse: Monocular 360°Depth Estimation by Collaboratively Learning Holistic-with-Regional Depth Distributions

Depth estimation from a monocular 360 image is a burgeoning problem owin...

0 Hao Ai, et al. ∙

research

∙ 03/20/2023

HMC: Hierarchical Mesh Coarsening for Skeleton-free Motion Retargeting

We present a simple yet effective method for skeleton-free motion retarg...

0 Haoyu Wang, et al. ∙

research

∙ 03/15/2023

Skinned Motion Retargeting with Residual Perception of Motion Semantics Geometry

A good motion retargeting cannot be reached without reasonable considera...

0 Jiaxu Zhang, et al. ∙

research

∙ 02/17/2023

Binary Embedding-based Retrieval at Tencent

Large-scale embedding-based retrieval (EBR) is the cornerstone of search...

4 Yukang Gan, et al. ∙

research

∙ 02/16/2023

T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models

The incredible generative ability of large-scale text-to-image (T2I) mod...

0 Chong Mou, et al. ∙

Ying Shan

Featured Co-authors