research
∙
09/07/2023
LanSER: Language-Model Supported Speech Emotion Recognition
Speech emotion recognition (SER) models typically rely on costly human-l...
share
research
∙
08/21/2023
UnLoc: A Unified Framework for Video Localization Tasks
While large-scale image-text pretrained models such as CLIP have been us...
research
∙
06/08/2023
Modular Visual Question Answering via Code Generation
We present a framework that formulates visual question answering as modu...
research
∙
04/13/2023
Verbs in Action: Improving verb understanding in video-language models
Understanding verbs is crucial to modelling how people and objects inter...
research
∙
04/05/2023
VicTR: Video-conditioned Text Representations for Activity Recognition
Vision-Language models have shown strong performance in the image-domain...
research
∙
03/29/2023
AutoAD: Movie Description in Context
The objective of this paper is an automatic Audio Description (AD) model...
research
∙
03/29/2023
AVFormer: Injecting Vision into Frozen Speech Models for Zero-Shot AV-ASR
Audiovisual automatic speech recognition (AV-ASR) aims to improve the ro...
research
∙
02/27/2023
Vid2Seq: Large-Scale Pretraining of a Visual Language Model for Dense Video Captioning
In this work, we introduce Vid2Seq, a multi-modal single-stage dense eve...
research
∙
11/18/2022
AVATAR submission to the Ego4D AV Transcription Challenge
In this report, we describe our submission to the Ego4D AudioVisual (AV)...
research
∙
08/14/2022
TL;DW? Summarizing Instructional Videos with Task Relevance Cross-Modal Saliency
YouTube users looking for instructions for a specific task may spend a l...
research
∙
06/20/2022
M M Mix: A Multimodal Multiview Transformer Ensemble
This report describes the approach behind our winning solution to the 20...
research
∙
06/15/2022
AVATAR: Unconstrained Audiovisual Speech Recognition
Audio-visual automatic speech recognition (AV-ASR) is an extension of AS...
research
∙
05/17/2022
A CLIP-Hitchhiker's Guide to Long Video Retrieval
Our goal in this paper is the adaptation of image-text models for long v...
research
∙
04/01/2022
Learning Audio-Video Modalities from Image Captions
A major challenge in text-video and text-audio retrieval is the lack of ...
research
∙
01/20/2022
End-to-end Generative Pretraining for Multimodal Video Captioning
Recent video and language pretraining frameworks lack the ability to gen...
research
∙
12/08/2021
Audio-Visual Synchronisation in the wild
In this paper, we consider the problem of audio-visual synchronisation a...
research
∙
11/01/2021
Masking Modalities for Cross-modal Video Retrieval
Pre-training on large scale unlabelled datasets has shown impressive per...
research
∙
11/01/2021
With a Little Help from my Temporal Context: Multimodal Egocentric Action Recognition
In egocentric videos, actions occur in quick succession. We capitalise o...
research
∙
06/30/2021
Attention Bottlenecks for Multimodal Fusion
Humans perceive the world by concurrently processing and fusing high-dim...
research
∙
04/06/2021
Localizing Visual Sounds the Hard Way
The objective of this work is to localize sound sources that are visible...
research
∙
04/01/2021
Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval
Our objective in this work is video-text retrieval - in particular a joi...
research
∙
04/01/2021
Composable Augmentation Encoding for Video Representation Learning
We focus on contrastive methods for self-supervised video representation...
research
∙
03/05/2021
Slow-Fast Auditory Streams For Audio Recognition
We propose a two-stream convolutional network for audio recognition, tha...
research
∙
01/11/2021
WiCV 2020: The Seventh Women In Computer Vision Workshop
In this paper we present the details of Women in Computer Vision Worksho...
research
∙
12/10/2020
Look Before you Speak: Visually Contextualized Utterances
While most conversational AI systems focus on textual dialogue only, con...
research
∙
09/17/2020
Cough Against COVID: Evidence of COVID-19 Signature in Cough Sounds
Testing capacity for COVID-19 remains a challenge globally due to the la...
research
∙
07/21/2020
Uncertainty-Aware Weakly Supervised Action Detection from Untrimmed Videos
Despite the recent advances in video classification, progress in spatio-...
research
∙
07/02/2020
Spot the conversation: speaker diarisation in the wild
The goal of this paper is speaker diarisation of videos collected 'in th...
research
∙
05/08/2020
Condensed Movies: Story Based Retrieval with Contextual Embeddings
Our objective in this work is the long range understanding of the narrat...
research
∙
03/30/2020
Speech2Action: Cross-modal Supervision for Action Recognition
Is it possible to guess human action from dialogue alone? In this work w...
research
∙
02/20/2020
Disentangled Speech Embeddings using Cross-modal Self-supervision
The objective of this paper is to learn representations of speaker ident...
research
∙
12/05/2019
VoxSRC 2019: The first VoxCeleb Speaker Recognition Challenge
The VoxCeleb Speaker Recognition Challenge 2019 aimed to assess how well...
research
∙
09/23/2019
WiCV 2019: The Sixth Women In Computer Vision Workshop
In this paper we present the Women in Computer Vision Workshop - WiCV 20...
research
∙
09/19/2019
Count, Crop and Recognise: Fine-Grained Recognition in the Wild
The goal of this paper is to label all the animal individuals present in...
research
∙
08/22/2019
EPIC-Fusion: Audio-Visual Temporal Binding for Egocentric Action Recognition
We focus on multi-modal fusion for egocentric action recognition, and pr...
research
∙
07/31/2019
Use What You Have: Video Retrieval Using Representations From Collaborative Experts
The rapid growth of video on the internet has made searching for video c...
research
∙
02/26/2019
Utterance-level Aggregation For Speaker Recognition In The Wild
The objective of this paper is speaker recognition "in the wild"-where u...
research
∙
08/16/2018
Emotion Recognition in Speech using Cross-Modal Transfer in the Wild
Obtaining large, human labelled speech datasets to train models for emot...
research
∙
06/14/2018
VoxCeleb2: Deep Speaker Recognition
The objective of this paper is speaker recognition under noisy and uncon...
research
∙
05/02/2018
Learnable PINs: Cross-Modal Embeddings for Person Identity
We propose and investigate an identity sensitive joint embedding of face...
research
∙
04/01/2018
Seeing Voices and Hearing Faces: Cross-modal biometric matching
We introduce a seemingly impossible task: given only an audio clip of so...
research
∙
01/31/2018
From Benedict Cumberbatch to Sherlock Holmes: Character Identification in TV series without a Script
The goal of this paper is the automatic identification of characters in ...
research
∙
06/26/2017