b'Yu Wu'

research

∙ 05/31/2023

Accurate and Structured Pruning for Efficient Automatic Speech Recognition

Automatic Speech Recognition (ASR) has seen remarkable advancements with...

0 Huiqiang Jiang, et al. ∙

research

∙ 04/28/2023

Click-Feedback Retrieval

Retrieving target information based on input query is of fundamental imp...

0 Zeyu Wang, et al. ∙

research

∙ 03/23/2023

Visually-Prompted Language Model for Fine-Grained Scene Graph Generation in an Open World

Scene Graph Generation (SGG) aims to extract <subject, predicate, object...

0 Qifan Yu, et al. ∙

research

∙ 02/16/2023

Boundary Guided Mixing Trajectory for Semantic Control with Diffusion Models

Applying powerful generative denoising diffusion models (DDMs) for downs...

5 Ye Zhu, et al. ∙

research

∙ 01/05/2023

Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers

We introduce a language modeling approach for text to speech synthesis (...

4 Chengyi Wang, et al. ∙

research

∙ 12/31/2022

Generative Graph Neural Networks for Link Prediction

Inferring missing links or detecting spurious ones based on observed gra...

0 Xingping Xian, et al. ∙

research

∙ 12/18/2022

BEATs: Audio Pre-Training with Acoustic Tokenizers

The massive growth of self-supervised learning (SSL) has been witnessed ...

0 Sanyuan Chen, et al. ∙

research

∙ 12/07/2022

Artificial Intelligence Security Competition (AISC)

The security of artificial intelligence (AI) is an important research ar...

12 Yinpeng Dong, et al. ∙

research

∙ 11/20/2022

Turning Silver into Gold: Domain Adaptation with Noisy Labels for Wearable Cardio-Respiratory Fitness Prediction

Deep learning models have shown great promise in various healthcare appl...

0 Yu Wu, et al. ∙

research

∙ 11/18/2022

Exploring WavLM on Speech Enhancement

There is a surge in interest in self-supervised learning approaches for ...

0 Hyungchan Song, et al. ∙

research

∙ 11/17/2022

LongFNT: Long-form Speech Recognition with Factorized Neural Transducer

Traditional automatic speech recognition (ASR) systems usually focus on ...

0 Xun Gong, et al. ∙

research

∙ 11/09/2022

Speech separation with large-scale self-supervised learning

Self-supervised learning (SSL) methods such as WavLM have shown promisin...

0 Zhuo Chen, et al. ∙

research

∙ 11/05/2022

LAMASSU: Streaming Language-Agnostic Multilingual Speech Recognition and Translation Using Neural Transducers

End-to-end formulation of automatic speech recognition (ASR) and speech ...

0 Peidong Wang, et al. ∙

research

∙ 11/02/2022

Two-Stream Network for Sign Language Recognition and Translation

Sign languages are visual languages using manual articulations and non-m...

0 Yutong Chen, et al. ∙

research

∙ 10/24/2022

Real-time Speech Interruption Analysis: From Cloud to Client Deployment

Meetings are an essential form of communication for all types of organiz...

0 Quchen Fu, et al. ∙

research

∙ 10/16/2022

STAR: Zero-Shot Chinese Character Recognition with Stroke- and Radical-Level Decompositions

Zero-shot Chinese character recognition has attracted rising attention i...

0 Jinshan Zeng, et al. ∙

research

∙ 10/12/2022

Foundation Transformers

A big convergence of model architectures across language, vision, speech...

26 Hongyu Wang, et al. ∙

research

∙ 10/05/2022

Vision+X: A Survey on Multimodal Learning in the Light of Data

We are perceiving and communicating with the world in a multisensory man...

1 Ye Zhu, et al. ∙

research

∙ 09/30/2022

SpeechLM: Enhanced Speech Pre-Training with Unpaired Textual Data

How to boost speech pre-training with textual data is an unsolved proble...

0 Ziqiang Zhang, et al. ∙

research

∙ 09/22/2022

The Microsoft System for VoxCeleb Speaker Recognition Challenge 2022

In this report, we describe our submitted system for track 2 of the VoxC...

0 Gang Liu, et al. ∙

research

∙ 07/27/2022

SiRi: A Simple Selective Retraining Mechanism for Transformer-based Visual Grounding

In this paper, we investigate how to achieve better visual grounding wit...

0 Mengxue Qu, et al. ∙

research

∙ 06/29/2022

Provably Efficient Reinforcement Learning for Online Adaptive Influence Maximization

Online influence maximization aims to maximize the influence spread of a...

3 Kaixuan Huang, et al. ∙

research

∙ 06/15/2022

Discrete Contrastive Diffusion for Cross-Modal and Conditional Generation

Diffusion probabilistic models (DPMs) have become a popular approach to ...

28 Ye Zhu, et al. ∙

research

∙ 04/27/2022

Ultra Fast Speech Separation Model with Teacher Student Learning

Transformer has been successfully applied to speech separation recently ...

0 Sanyuan Chen, et al. ∙

research

∙ 04/27/2022

Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition?

Recently, self-supervised learning (SSL) has demonstrated strong perform...

0 Sanyuan Chen, et al. ∙

research

∙ 04/14/2022

A collaborative decomposition-based evolutionary algorithm integrating normal and penalty-based boundary intersection for many-objective optimization

Decomposition-based evolutionary algorithms have become fairly popular f...

0 Yu Wu, et al. ∙

research

∙ 04/07/2022

Speech Pre-training with Acoustic Piece

Previous speech pre-training methods, such as wav2vec2.0 and HuBERT, pre...

0 Shuo Ren, et al. ∙

research

∙ 04/01/2022

Quantized GAN for Complex Music Generation from Dance Videos

We present Dance2Music-GAN (D2M-GAN), a novel adversarial multi-modal fr...

4 Ye Zhu, et al. ∙

research

∙ 03/30/2022

Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings

This paper presents a streaming speaker-attributed automatic speech reco...

0 Naoyuki Kanda, et al. ∙

research

∙ 02/02/2022

Streaming Multi-Talker ASR with Token-Level Serialized Output Training

This paper proposes a token-level serialized output training (t-SOT), a ...

0 Naoyuki Kanda, et al. ∙

research

∙ 01/10/2022

Multi-query Video Retrieval

Retrieving target videos based on text descriptions is a task of great p...

0 Zeyu Wang, et al. ∙

research

∙ 12/16/2021

Self-Supervised Learning for speech recognition with Intermediate layer supervision

Recently, pioneer work finds that speech pre-trained models can solve fu...

0 Chengyi Wang, et al. ∙

research

∙ 10/26/2021

WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing

Self-supervised learning (SSL) achieves great success in speech recognit...

0 Sanyuan Chen, et al. ∙

research

∙ 10/12/2021

Large-scale Self-Supervised Speech Representation Learning for Automatic Speaker Verification

The speech representations learned from large-scale unlabeled data have ...

0 Zhengyang Chen, et al. ∙

research

∙ 10/12/2021

UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Training

Self-supervised learning (SSL) is a long-standing goal for speech proces...

0 Sanyuan Chen, et al. ∙

research

∙ 10/06/2021

Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition

Text-only adaptation of an end-to-end (E2E) model remains a challenging ...

0 Zhong Meng, et al. ∙

research

∙ 09/29/2021

Contrastive Video-Language Segmentation

We focus on the problem of segmenting a certain object referred by a nat...

0 Chen Liang, et al. ∙

research

∙ 09/12/2021

Knowledge Enhanced Fine-Tuning for Better Handling Unseen Entities in Dialogue Generation

Although pre-training models have achieved great success in dialogue gen...

0 Leyang Cui, et al. ∙

research

∙ 09/03/2021

Detecting Speaker Personas from Conversational Texts

Personas are useful for dialogue response prediction. However, the perso...

0 Jia-Chen Gu, et al. ∙

research

∙ 08/22/2021

Flexible Clustered Federated Learning for Client-Level Data Distribution Shift

Federated Learning (FL) enables the multiple participating devices to co...

4 Moming Duan, et al. ∙

research

∙ 07/05/2021

Investigation of Practical Aspects of Single Channel Speech Separation for ASR

Speech separation has been successfully applied as a frontend processing...

0 Jian Wu, et al. ∙

research

∙ 06/26/2021

Saying the Unseen: Video Descriptions via Dialog Agents

Current vision and language tasks usually take complete visual data (e.g...

0 Ye Zhu, et al. ∙

research

∙ 06/04/2021

Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition

Integrating external language models (LMs) into end-to-end (E2E) models ...

0 Zhong Meng, et al. ∙

research

∙ 06/02/2021

Rethinking Cross-modal Interaction from a Top-down Perspective for Referring Video Object Segmentation

Referring video object segmentation (RVOS) aims to segment video objects...

0 Chen Liang, et al. ∙

research

∙ 03/31/2021

Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone

Transcribing meetings containing overlapped speech with only a single di...

0 Naoyuki Kanda, et al. ∙

research

∙ 03/19/2021

ClawCraneNet: Leveraging Object-level Relation for Text-based Video Segmentation

Text-based video segmentation is a challenging task that segments out th...

0 Chen Liang, et al. ∙

research

∙ 03/09/2021

Virtual Reality Sickness Mitigation Methods: A Comparative Study in a Racing Game

Using virtual reality (VR) head-mounted displays (HMDs) can induce VR si...

0 Rongkai Shi, et al. ∙

research

∙ 02/05/2021

Learning Audio-Visual Correlations from Variational Cross-Modal Generation

People can easily imagine the potential sound while seeing an event. Thi...

0 Ye Zhu, et al. ∙

research

∙ 01/19/2021

UniSpeech: Unified Speech Representation Learning with Labeled and Unlabeled Data

In this paper, we propose a unified pre-training approach called UniSpee...

21 Chengyi Wang, et al. ∙

research

∙ 01/13/2021

Learning to Anticipate Egocentric Actions by Imagination

Anticipating actions before they are executed is crucial for a wide rang...

0 Yu Wu, et al. ∙

Yu Wu

Featured Co-authors