research
∙
09/11/2023
Class-Incremental Grouping Network for Continual Audio-Visual Learning
Continual learning is a challenging problem in which models need to be t...
share
research
∙
08/30/2023
SignDiff: Learning Diffusion Models for American Sign Language Production
The field of Sign Language Production (SLP) lacked a large-scale, pre-tr...
research
∙
08/26/2023
DiffI2I: Efficient Diffusion Model for Image-to-Image Translation
The Diffusion Model (DM) has emerged as the SOTA approach for image synt...
research
∙
08/21/2023
Audio-Visual Class-Incremental Learning
In this paper, we introduce audio-visual class-incremental learning, a c...
research
∙
07/31/2023
DAVIS: High-Quality Audio-Visual Separation with Generative Diffusion Models
We propose DAVIS, a Diffusion model-based Audio-VIusal Separation framew...
research
∙
07/27/2023
PEANUT: A Human-AI Collaborative Tool for Annotating Audio-Visual Data
Audio-visual learning seeks to enhance the computer's multi-modal percep...
research
∙
07/05/2023
Dual Arbitrary Scale Super-Resolution for Multi-Contrast MRI
Limited by imaging systems, the reconstruction of Magnetic Resonance Ima...
research
∙
06/15/2023
Towards Long Form Audio-visual Video Understanding
We live in a world filled with never-ending streams of multimodal inform...
research
∙
05/24/2023
EgoVSR: Towards High-Quality Egocentric Video Super-Resolution
Due to the limitations of capture devices and scenarios, egocentric vide...
research
∙
05/22/2023
DiffAVA: Personalized Text-to-Audio Generation with Visual Alignment
Text-to-audio (TTA) generation is a recent popular problem that aims to ...
research
∙
05/03/2023
AV-SAM: Segment Anything Model Meets Audio-Visual Localization and Segmentation
Segment Anything Model (SAM) has recently shown its powerful effectivene...
research
∙
03/29/2023
Audio-Visual Grouping Network for Sound Localization from Mixtures
Sound source localization is a typical and challenging task that predict...
research
∙
03/23/2023
Egocentric Audio-Visual Object Localization
Humans naturally perceive surrounding scenes by unifying sound and sight...
research
∙
03/16/2023
DiffIR: Efficient Diffusion Model for Image Restoration
Diffusion model (DM) has achieved SOTA performance by modeling the image...
research
∙
02/04/2023
AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesis
Human perception of the complex world relies on a comprehensive analysis...
research
∙
11/30/2022
Knowledge Distillation based Degradation Estimation for Blind Super-Resolution
Blind image super-resolution (Blind-SR) aims to recover a high-resolutio...
research
∙
10/02/2022
Basic Binary Convolution Unit for Binarized Image Restoration Network
Lighter and faster image restoration (IR) models are crucial for the dep...
research
∙
08/20/2022
Learning in Audio-visual Context: A Review, Analysis, and New Perspective
Sight and hearing are two senses that play a vital role in human communi...
research
∙
07/28/2022
Meta-Learning based Degradation Representation for Blind Super-Resolution
The most of CNN based super-resolution (SR) methods assume that the degr...
research
∙
03/26/2022
Learning to Answer Questions in Dynamic Audio-Visual Scenarios
In this paper, we focus on the Audio-Visual Question Answering (AVQA) ta...
research
∙
03/26/2022
Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolution
Magnetic resonance imaging (MRI) can present multi-contrast images of th...
research
∙
03/15/2022
Learning Spatio-Temporal Downsampling for Effective Video Upscaling
Downsampling is one of the most basic image processing operations. Impro...
research
∙
03/14/2022
STDAN: Deformable Attention Network for Space-Time Video Super-Resolution
The target of space-time video super-resolution (STVSR) is to increase t...
research
∙
01/12/2022
Coarse-to-Fine Embedded PatchMatch and Multi-Scale Dynamic Aggregation for Reference-based Super-Resolution
Reference-based super-resolution (RefSR) has made significant progress i...
research
∙
01/11/2022
Efficient Non-Local Contrastive Attention for Image Super-Resolution
Non-Local Attention (NLA) brings significant improvement for Single Imag...
research
∙
11/10/2021
Space-Time Memory Network for Sounding Object Localization in Videos
Leveraging temporal synchronization and association within sight and sou...
research
∙
04/15/2021
Zooming SlowMo: An Efficient One-Stage Framework for Space-Time Video Super-Resolution
In this paper, we address the space-time video super-resolution, which a...
research
∙
04/05/2021
Cyclic Co-Learning of Sounding Object Visual Grounding and Sound Separation
There are rich synchronized audio and visual events in our daily life. I...
research
∙
04/05/2021
Can audio-visual integration strengthen robustness under multimodal attacks?
In this paper, we propose to make a systematic study on machines multise...
research
∙
07/21/2020
Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing
In this paper, we introduce a new problem, named audio-visual video pars...
research
∙
02/26/2020
Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolution
In this paper, we explore the space-time video super-resolution task, wh...
research
∙
12/21/2019
Deep Audio Prior
Deep convolutional neural networks are known to specialize in distilling...
research
∙
09/09/2019
LCSCNet: Linear Compressing Based Skip-Connecting Network for Image Super-Resolution
In this paper, we develop a concise but efficient network architecture c...
research
∙
04/01/2019
CFSNet: Toward a Controllable Feature Space for Image Restoration
Deep learning methods have witnessed the great progress in image restora...
research
∙
12/25/2018
Residual Dense Network for Image Restoration
Convolutional neural network has recently achieved great success for ima...
research
∙
12/07/2018
TDAN: Temporally Deformable Alignment Network for Video Super-Resolution
Video super-resolution (VSR) aims to restore a photo-realistic high-reso...
research
∙
12/07/2018
An Attempt towards Interpretable Audio-Visual Video Captioning
Automatically generating a natural language sentence to describe the con...
research
∙
08/09/2018
Deep Learning for Single Image Super-Resolution: A Brief Review
Single image super-resolution (SISR) is a notoriously challenging ill-po...
research
∙
03/23/2018
Audio-Visual Event Localization in Unconstrained Videos
In this paper, we introduce a novel problem of audio-visual event locali...
research
∙
02/24/2018