b'Maja Pantic'

research

∙ 07/31/2023

Audio-visual video-to-speech synthesis with synthesized input audio

Video-to-speech synthesis involves reconstructing the speech signal of a...

0 Triantafyllos Kefalas, et al. ∙

research

∙ 07/10/2023

SparseVSR: Lightweight and Noise Robust Visual Speech Recognition

Recent advances in deep neural networks have achieved unprecedented succ...

0 Adriana Fernandez-Lopez, et al. ∙

research

∙ 06/27/2023

Large-scale unsupervised audio pre-training for video-to-speech synthesis

Video-to-speech synthesis is the task of reconstructing the speech signa...

0 Triantafyllos Kefalas, et al. ∙

research

∙ 05/15/2023

Laughing Matters: Introducing Laughing-Face Generation using Diffusion Models

Speech-driven animation has gained significant traction in recent years,...

0 Antoni Bigata Casademunt, et al. ∙

research

∙ 03/30/2023

SynthVSR: Scaling Up Visual Speech Recognition With Synthetic Supervision

Recently reported state-of-the-art results in visual speech recognition ...

0 Xubo Liu, et al. ∙

research

∙ 03/25/2023

Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labels

Audio-visual speech recognition has received a lot of attention due to i...

0 Pingchuan Ma, et al. ∙

research

∙ 03/14/2023

Learning Cross-lingual Visual Speech Representations

Cross-lingual self-supervised learning has been a growing research topic...

0 Andreas Zinonos, et al. ∙

research

∙ 01/06/2023

Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generation

Talking face generation has historically struggled to produce head movem...

0 Michał Stypułkowski, et al. ∙

research

∙ 12/12/2022

Jointly Learning Visual and Auditory Speech Representations from Raw Data

We present RAVEn, a self-supervised multi-modal approach to jointly lear...

0 Alexandros Haliassos, et al. ∙

research

∙ 11/20/2022

LA-VocE: Low-SNR Audio-visual Speech Enhancement using Neural Vocoders

Audio-visual speech enhancement aims to extract clean speech from a nois...

0 Rodrigo Mira, et al. ∙

research

∙ 11/11/2022

FAN-Trans: Online Knowledge Distillation for Facial Action Unit Detection

Due to its importance in facial behaviour analysis, facial action unit (...

0 Jing Yang, et al. ∙

research

∙ 11/03/2022

Streaming Audio-Visual Speech Recognition with Alignment Regularization

Recognizing a word shortly after it is spoken is an important requiremen...

0 Pingchuan Ma, et al. ∙

research

∙ 10/20/2022

SS-VAERR: Self-Supervised Apparent Emotional Reaction Recognition from Video

This work focuses on the apparent emotional reaction recognition (AERR) ...

0 Marija Jegorova, et al. ∙

research

∙ 09/03/2022

Training Strategies for Improved Lip-reading

Several training strategies and temporal models have been recently propo...

10 Pingchuan Ma, et al. ∙

research

∙ 05/04/2022

SVTS: Scalable Video-to-Speech Synthesis

Video-to-speech synthesis (also known as lip-to-speech) refers to the tr...

11 Rodrigo Mira, et al. ∙

research

∙ 03/24/2022

Self-supervised Video-centralised Transformer for Video Face Clustering

This paper presents a novel method for face clustering in videos using a...

15 Yujiang Wang, et al. ∙

research

∙ 02/26/2022

Visual Speech Recognition for Multiple Languages in the Wild

Visual speech recognition (VSR) aims to recognise the content of speech ...

5 Pingchuan Ma, et al. ∙

research

∙ 01/18/2022

Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection

One of the most pressing challenges for the detection of face-manipulate...

3 Alexandros Haliassos, et al. ∙

research

∙ 10/26/2021

Defensive Tensorization

We propose defensive tensorization, an adversarial defence technique tha...

4 Adrian Bulat, et al. ∙

research

∙ 10/18/2021

Domain Generalisation for Apparent Emotional Facial Expression Recognition across Age-Groups

Apparent emotional facial expression recognition has attracted a lot of ...

4 Rafael Poyiadzi, et al. ∙

research

∙ 07/09/2021

EasyCom: An Augmented Reality Dataset to Support Algorithms for Easy Communication in Noisy Environments

Augmented Reality (AR) as a platform has the potential to facilitate the...

16 Jacob Donley, et al. ∙

research

∙ 06/21/2021

FP-Age: Leveraging Face Parsing Attention for Facial Age Estimation in the Wild

Image-based age estimation aims to predict a person's age from facial im...

8 Yiming Lin, et al. ∙

research

∙ 06/16/2021

LiRA: Learning Visual Speech Representations from Audio through Self-supervision

The large amount of audiovisual content being shared online today has dr...

5 Pingchuan Ma, et al. ∙

research

∙ 04/27/2021

End-to-End Video-To-Speech Synthesis using Generative Adversarial Networks

Video-to-speech is the process of reconstructing the audio speech from a...

12 Rodrigo Mira, et al. ∙

research

∙ 02/18/2021

DINO: A Conditional Energy-Based GAN for Domain Translation

Domain translation is the process of transforming data from one domain t...

22 Konstantinos Vougioukas, et al. ∙

research

∙ 02/12/2021

End-to-end Audio-visual Speech Recognition with Conformers

In this work, we present a hybrid CTC/Attention model based on a ResNet-...

12 Pingchuan Ma, et al. ∙

research

∙ 02/04/2021

RoI Tanh-polar Transformer Network for Face Parsing in the Wild

Face parsing aims to predict pixel-wise labels for facial components of ...

7 Yiming Lin, et al. ∙

research

∙ 01/06/2021

Cauchy-Schwarz Regularized Autoencoder

Recent work in unsupervised learning has focused on efficient inference ...

34 Linh Tran, et al. ∙

research

∙ 12/14/2020

Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detection

Although current deep learning-based face forgery detectors achieve impr...

5 Alexandros Haliassos, et al. ∙

research

∙ 09/29/2020

Lip-reading with Densely Connected Temporal Convolutional Networks

In this work, we present the Densely Connected Temporal Convolutional Ne...

36 Pingchuan Ma, et al. ∙

research

∙ 09/09/2020

Multilinear Latent Conditioning for Generating Unseen Attribute Combinations

Deep generative models rely on their inductive bias to facilitate genera...

15 Markos Georgopoulos, et al. ∙

research

∙ 07/13/2020

Towards practical lipreading with distilled and efficient models

Lipreading has witnessed a lot of progress due to the resurgence of neur...

0 Pingchuan Ma, et al. ∙

research

∙ 07/08/2020

Learning Speech Representations from Raw Audio by Joint Audiovisual Self-Supervision

The intuitive interaction between the audio and visual modalities is val...

45 Abhinav Shukla, et al. ∙

research

∙ 06/06/2020

Enhancing Facial Data Diversity with Style-based Face Aging

A significant limiting factor in training fair classifiers relates to th...

3 Markos Georgopoulos, et al. ∙

research

∙ 06/05/2020

Dilated Convolutions with Lateral Inhibitions for Semantic Image Segmentation

Dilated convolutions are widely used in deep semantic segmentation model...

0 Yujiang Wang, et al. ∙

research

∙ 05/15/2020

Investigating Bias in Deep Face Analysis: The KANFace Dataset and Empirical Study

Deep learning-based methods have pushed the limits of the state-of-the-a...

14 Markos Georgopoulos, et al. ∙

research

∙ 05/04/2020

Does Visual Self-Supervision Improve Learning of Speech Representations?

Self-supervised learning has attracted plenty of recent research interes...

17 Abhinav Shukla, et al. ∙

research

∙ 02/25/2020

Toward fast and accurate human pose estimation via soft-gated skip connections

This paper is on highly accurate and highly efficient human pose estimat...

0 Adrian Bulat, et al. ∙

research

∙ 01/23/2020

Lipreading using Temporal Convolutional Networks

Lip-reading has attracted a lot of research attention lately thanks to a...

13 Brais Martinez, et al. ∙

research

∙ 01/13/2020

Visually Guided Self Supervised Learning of Speech Representations

Self supervised representation learning has recently attracted a lot of ...

32 Abhinav Shukla, et al. ∙

research

∙ 12/18/2019

Detecting Adversarial Attacks On Audio-Visual Speech Recognition

Adversarial attacks pose a threat to deep learning models. However, rese...

22 Pingchuan Ma, et al. ∙

research

∙ 12/12/2019

Speech-driven facial animation using polynomial fusion of features

Speech-driven facial animation involves using a speech signal to generat...

15 Triantafyllos Kefalas, et al. ∙

research

∙ 11/14/2019

Towards Pose-invariant Lip-Reading

Lip-reading models have been significantly improved recently thanks to p...

19 Shiyang Cheng, et al. ∙

research

∙ 10/11/2019

Shape Constrained Network for Eye Segmentation in the Wild

Semantic segmentation of eyes has long been a vital pre-processing step ...

11 Bingnan Luo, et al. ∙

research

∙ 09/26/2019

Fast and Effective Adaptation of Facial Action Unit Detection Deep Model

Detecting facial action units (AU) is one of the fundamental steps in au...

4 Mihee Lee, et al. ∙

research

∙ 07/10/2019

AVEC 2019 Workshop and Challenge: State-of-Mind, Detecting Depression with AI, and Cross-Cultural Affect Recognition

The Audio/Visual Emotion Challenge and Workshop (AVEC 2019) "State-of-Mi...

0 Fabien Ringeval, et al. ∙

research

∙ 07/02/2019

Dynamic Face Video Segmentation via Reinforcement Learning

For real-time semantic video segmentation, most recent works utilise a d...

8 Yujiang Wang, et al. ∙

research

∙ 06/14/2019

Video-Driven Speech Reconstruction using Generative Adversarial Networks

Speech is a means of communication which relies on both audio and visual...

2 Konstantinos Vougioukas, et al. ∙

research

∙ 06/14/2019

Realistic Speech-Driven Facial Animation with GANs

Speech-driven facial animation is the process that automatically synthes...

4 Konstantinos Vougioukas, et al. ∙

research

∙ 06/14/2019

Efficient N-Dimensional Convolutions via Higher-Order Factorization

With the unprecedented success of deep convolutional neural networks cam...

3 Jean Kossaifi, et al. ∙

Maja Pantic

Featured Co-authors