Marco Tagliasacchi

research

∙ 08/21/2023

TokenSplit: Using Discrete Speech Representations for Direct, Refined, and Transcript-Conditioned Speech Separation and Recognition

We present TokenSplit, a speech separation model that acts on discrete t...

0 Hakan Erdogan, et al. ∙

research

∙ 06/22/2023

AudioPaLM: A Large Language Model That Can Speak and Listen

We introduce AudioPaLM, a large language model for speech understanding ...

0 Paul K. Rubenstein, et al. ∙

research

∙ 05/16/2023

SoundStorm: Efficient Parallel Audio Generation

We present SoundStorm, a model for efficient, non-autoregressive audio g...

0 Zalán Borsos, et al. ∙

research

∙ 03/23/2023

LMCodec: A Low Bitrate Speech Codec With Causal Transformer Models

We introduce LMCodec, a causal neural speech codec that provides high qu...

0 Teerapat Jenrungrot, et al. ∙

research

∙ 02/07/2023

Speak, Read and Prompt: High-Fidelity Text-to-Speech with Minimal Supervision

We introduce SPEAR-TTS, a multi-speaker text-to-speech (TTS) system that...

0 Eugene Kharitonov, et al. ∙

research

∙ 01/26/2023

MusicLM: Generating Music From Text

We introduce MusicLM, a model generating high-fidelity music from text d...

0 Andrea Agostinelli, et al. ∙

research

∙ 09/07/2022

AudioLM: a Language Modeling Approach to Audio Generation

We introduce AudioLM, a framework for high-quality audio generation with...

17 Zalán Borsos, et al. ∙

research

∙ 04/12/2022

Text-Driven Separation of Arbitrary Sounds

We propose a method of separating a desired sound source from a single-c...

0 Kevin Kilgour, et al. ∙

research

∙ 03/29/2022

CycleGAN-Based Unpaired Speech Dereverberation

Typically, neural network-based speech dereverberation models are traine...

0 Hannah Muckenhirn, et al. ∙

research

∙ 03/29/2022

Disentangling speech from surroundings in a neural audio codec

We present a method to separate speech signals from noisy environments i...

11 Ahmed Omran, et al. ∙

research

∙ 03/01/2022

Real time spectrogram inversion on mobile phone

With the growth of computing power on mobile phones and privacy concerns...

0 Oleg Rybakov, et al. ∙

research

∙ 02/15/2022

SpeechPainter: Text-conditioned Speech Inpainting

We propose SpeechPainter, a model for filling in gaps of up to one secon...

0 Zalán Borsos, et al. ∙

research

∙ 09/26/2021

Data Summarization via Bilevel Optimization

The increasing availability of massive data sets poses a series of chall...

0 Zalán Borsos, et al. ∙

research

∙ 07/07/2021

SoundStream: An End-to-End Neural Audio Codec

We present SoundStream, a novel neural audio codec that can efficiently ...

5 Neil Zeghidour, et al. ∙

research

∙ 05/05/2021

Self-Supervised Learning from Automatically Separated Sound Scenes

Real-world sound scenes consist of time-varying collections of sound sou...

0 Eduardo Fonseca, et al. ∙

research

∙ 01/21/2021

LEAF: A Learnable Frontend for Audio Classification

Mel-filterbanks are fixed, engineered audio features which emulate human...

10 Neil Zeghidour, et al. ∙

research

∙ 10/21/2020

Real-time Speech Frequency Bandwidth Extension

In this paper we propose a lightweight model for frequency bandwidth ext...

0 Yunpeng Li, et al. ∙

research

∙ 10/19/2020

MicAugment: One-shot Microphone Style Transfer

A crucial aspect for the successful deployment of audio-based models "in...

0 Zalán Borsos, et al. ∙

research

∙ 10/19/2020

Semi-supervised Batch Active Learning via Bilevel Optimization

Active learning is an effective technique for reducing the labeling cost...

0 Zalán Borsos, et al. ∙

research

∙ 09/04/2020

SEANet: A Multi-modal Speech Enhancement Network

We explore the possibility of leveraging accelerometer data to perform s...

0 Marco Tagliasacchi, et al. ∙

research

∙ 08/05/2020

Learning to Denoise Historical Music

We propose an audio-to-audio neural network model that learns to denoise...

0 Yunpeng Li, et al. ∙

research

∙ 02/25/2020

Towards Learning a Universal Non-Semantic Representation of Speech

The ultimate goal of transfer learning is to reduce labeled data require...

0 Joel Shor, et al. ∙

research

∙ 10/25/2019

Learning audio representations via phase prediction

We learn audio representations by solving a novel self-supervised learni...

0 Félix de Chaumont Quitry, et al. ∙

research

∙ 10/25/2019

SPICE: Self-supervised Pitch Estimation

We propose a model to estimate the fundamental frequency in monophonic a...

0 Beat Gfeller, et al. ∙

research

∙ 05/24/2019

From Here to There: Video Inbetweening Using Direct 3D Convolutions

We consider the problem of generating plausible and diverse video sequen...

0 Yunpeng Li, et al. ∙

research

∙ 05/24/2019

Self-supervised audio representation learning for mobile devices

We explore self-supervised models that can be potentially deployed on mo...

0 Marco Tagliasacchi, et al. ∙

research

∙ 10/13/2015

Deep convolutional neural networks for pedestrian detection

Pedestrian detection is a popular research topic due to its paramount im...

0 Denis Tome, et al. ∙

research

∙ 07/31/2015

SnowWatch: Snow Monitoring through Acquisition and Analysis of User-Generated Content

We present a system for complementing snow phenomena monitoring with vir...

0 Roman Fedorov, et al. ∙

research

∙ 03/24/2015

Fast keypoint detection in video sequences

A number of computer vision tasks exploit a succinct representation of t...

0 Luca Baroffio, et al. ∙

research

∙ 02/27/2015

Hybrid coding of visual content and local image features

Distributed visual analysis applications, such as mobile visual search o...

0 Luca Baroffio, et al. ∙

research

∙ 02/26/2015

Coding local and global binary visual features extracted from video sequences

Binary local features represent an effective alternative to real-valued ...

0 Luca Baroffio, et al. ∙

Marco Tagliasacchi

Featured Co-authors