research
∙
07/31/2023
Audio-visual video-to-speech synthesis with synthesized input audio
Video-to-speech synthesis involves reconstructing the speech signal of a...
share
research
∙
07/10/2023
SparseVSR: Lightweight and Noise Robust Visual Speech Recognition
Recent advances in deep neural networks have achieved unprecedented succ...
research
∙
06/27/2023
Large-scale unsupervised audio pre-training for video-to-speech synthesis
Video-to-speech synthesis is the task of reconstructing the speech signa...
research
∙
05/15/2023
Laughing Matters: Introducing Laughing-Face Generation using Diffusion Models
Speech-driven animation has gained significant traction in recent years,...
research
∙
03/30/2023
SynthVSR: Scaling Up Visual Speech Recognition With Synthetic Supervision
Recently reported state-of-the-art results in visual speech recognition ...
research
∙
03/25/2023
Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labels
Audio-visual speech recognition has received a lot of attention due to i...
research
∙
03/14/2023
Learning Cross-lingual Visual Speech Representations
Cross-lingual self-supervised learning has been a growing research topic...
research
∙
01/06/2023
Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generation
Talking face generation has historically struggled to produce head movem...
research
∙
12/12/2022
Jointly Learning Visual and Auditory Speech Representations from Raw Data
We present RAVEn, a self-supervised multi-modal approach to jointly lear...
research
∙
11/20/2022
LA-VocE: Low-SNR Audio-visual Speech Enhancement using Neural Vocoders
Audio-visual speech enhancement aims to extract clean speech from a nois...
research
∙
11/11/2022
FAN-Trans: Online Knowledge Distillation for Facial Action Unit Detection
Due to its importance in facial behaviour analysis, facial action unit (...
research
∙
11/03/2022
Streaming Audio-Visual Speech Recognition with Alignment Regularization
Recognizing a word shortly after it is spoken is an important requiremen...
research
∙
10/20/2022
SS-VAERR: Self-Supervised Apparent Emotional Reaction Recognition from Video
This work focuses on the apparent emotional reaction recognition (AERR) ...
research
∙
09/03/2022
Training Strategies for Improved Lip-reading
Several training strategies and temporal models have been recently propo...
research
∙
05/04/2022
SVTS: Scalable Video-to-Speech Synthesis
Video-to-speech synthesis (also known as lip-to-speech) refers to the tr...
research
∙
03/24/2022
Self-supervised Video-centralised Transformer for Video Face Clustering
This paper presents a novel method for face clustering in videos using a...
research
∙
02/26/2022
Visual Speech Recognition for Multiple Languages in the Wild
Visual speech recognition (VSR) aims to recognise the content of speech ...
research
∙
01/18/2022
Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection
One of the most pressing challenges for the detection of face-manipulate...
research
∙
10/26/2021
Defensive Tensorization
We propose defensive tensorization, an adversarial defence technique tha...
research
∙
10/18/2021
Domain Generalisation for Apparent Emotional Facial Expression Recognition across Age-Groups
Apparent emotional facial expression recognition has attracted a lot of ...
research
∙
07/09/2021
EasyCom: An Augmented Reality Dataset to Support Algorithms for Easy Communication in Noisy Environments
Augmented Reality (AR) as a platform has the potential to facilitate the...
research
∙
06/21/2021
FP-Age: Leveraging Face Parsing Attention for Facial Age Estimation in the Wild
Image-based age estimation aims to predict a person's age from facial im...
research
∙
06/16/2021
LiRA: Learning Visual Speech Representations from Audio through Self-supervision
The large amount of audiovisual content being shared online today has dr...
research
∙
04/27/2021
End-to-End Video-To-Speech Synthesis using Generative Adversarial Networks
Video-to-speech is the process of reconstructing the audio speech from a...
research
∙
02/18/2021
DINO: A Conditional Energy-Based GAN for Domain Translation
Domain translation is the process of transforming data from one domain t...
research
∙
02/12/2021
End-to-end Audio-visual Speech Recognition with Conformers
In this work, we present a hybrid CTC/Attention model based on a ResNet-...
research
∙
02/04/2021
RoI Tanh-polar Transformer Network for Face Parsing in the Wild
Face parsing aims to predict pixel-wise labels for facial components of ...
research
∙
01/06/2021
Cauchy-Schwarz Regularized Autoencoder
Recent work in unsupervised learning has focused on efficient inference ...
research
∙
12/14/2020
Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detection
Although current deep learning-based face forgery detectors achieve impr...
research
∙
09/29/2020
Lip-reading with Densely Connected Temporal Convolutional Networks
In this work, we present the Densely Connected Temporal Convolutional Ne...
research
∙
09/09/2020
Multilinear Latent Conditioning for Generating Unseen Attribute Combinations
Deep generative models rely on their inductive bias to facilitate genera...
research
∙
07/13/2020
Towards practical lipreading with distilled and efficient models
Lipreading has witnessed a lot of progress due to the resurgence of neur...
research
∙
07/08/2020
Learning Speech Representations from Raw Audio by Joint Audiovisual Self-Supervision
The intuitive interaction between the audio and visual modalities is val...
research
∙
06/06/2020
Enhancing Facial Data Diversity with Style-based Face Aging
A significant limiting factor in training fair classifiers relates to th...
research
∙
06/05/2020
Dilated Convolutions with Lateral Inhibitions for Semantic Image Segmentation
Dilated convolutions are widely used in deep semantic segmentation model...
research
∙
05/15/2020
Investigating Bias in Deep Face Analysis: The KANFace Dataset and Empirical Study
Deep learning-based methods have pushed the limits of the state-of-the-a...
research
∙
05/04/2020
Does Visual Self-Supervision Improve Learning of Speech Representations?
Self-supervised learning has attracted plenty of recent research interes...
research
∙
02/25/2020
Toward fast and accurate human pose estimation via soft-gated skip connections
This paper is on highly accurate and highly efficient human pose estimat...
research
∙
01/23/2020
Lipreading using Temporal Convolutional Networks
Lip-reading has attracted a lot of research attention lately thanks to a...
research
∙
01/13/2020
Visually Guided Self Supervised Learning of Speech Representations
Self supervised representation learning has recently attracted a lot of ...
research
∙
12/18/2019
Detecting Adversarial Attacks On Audio-Visual Speech Recognition
Adversarial attacks pose a threat to deep learning models. However, rese...
research
∙
12/12/2019
Speech-driven facial animation using polynomial fusion of features
Speech-driven facial animation involves using a speech signal to generat...
research
∙
11/14/2019
Towards Pose-invariant Lip-Reading
Lip-reading models have been significantly improved recently thanks to p...
research
∙
10/11/2019
Shape Constrained Network for Eye Segmentation in the Wild
Semantic segmentation of eyes has long been a vital pre-processing step ...
research
∙
09/26/2019
Fast and Effective Adaptation of Facial Action Unit Detection Deep Model
Detecting facial action units (AU) is one of the fundamental steps in au...
research
∙
07/10/2019
AVEC 2019 Workshop and Challenge: State-of-Mind, Detecting Depression with AI, and Cross-Cultural Affect Recognition
The Audio/Visual Emotion Challenge and Workshop (AVEC 2019) "State-of-Mi...
research
∙
07/02/2019
Dynamic Face Video Segmentation via Reinforcement Learning
For real-time semantic video segmentation, most recent works utilise a d...
research
∙
06/14/2019
Video-Driven Speech Reconstruction using Generative Adversarial Networks
Speech is a means of communication which relies on both audio and visual...
research
∙
06/14/2019
Realistic Speech-Driven Facial Animation with GANs
Speech-driven facial animation is the process that automatically synthes...
research
∙
06/14/2019