b'Jun Du'

research

∙ 09/17/2023

Continuous Modeling of the Denoising Process for Speech Enhancement Based on Deep Learning

In this paper, we explore a continuous modeling approach for deep-learni...

0 Zilu Guo, et al. ∙

research

∙ 09/17/2023

Neural Speaker Diarization Using Memory-Aware Multi-Speaker Embedding with Sequence-to-Sequence Architecture

We propose a novel neural speaker diarization system using memory-aware ...

0 Gaobin Yang, et al. ∙

research

∙ 09/15/2023

The Multimodal Information Based Speech Processing (MISP) 2023 Challenge: Audio-Visual Target Speaker Extraction

Previous Multimodal Information based Speech Processing (MISP) challenge...

0 Shilong Wu, et al. ∙

research

∙ 08/28/2023

The USTC-NERCSLIP Systems for the CHiME-7 DASR Challenge

This technical report details our submission system to the CHiME-7 DASR ...

0 Ruoyu Wang, et al. ∙

research

∙ 08/14/2023

Improving Audio-Visual Speech Recognition by Lip-Subword Correlation Based Visual Pre-training and Cross-Modal Fusion Encoder

In recent research, slight performance improvement is observed from auto...

0 Yusheng Dai, et al. ∙

research

∙ 07/30/2023

Count, Decode and Fetch: A New Approach to Handwritten Chinese Character Error Correction

Recently, handwritten Chinese character error correction has been greatl...

0 Pengfei Hu, et al. ∙

research

∙ 06/14/2023

Variance-Preserving-Based Interpolation Diffusion Models for Speech Enhancement

The goal of this study is to implement diffusion models for speech enhan...

15 Zilu Guo, et al. ∙

research

∙ 03/24/2023

HRDoc: Dataset and Baseline Method Toward Hierarchical Reconstruction of Document Structures

The problem of document structure reconstruction refers to converting di...

0 Jiefeng Ma, et al. ∙

research

∙ 03/11/2023

The Multimodal Information based Speech Processing (MISP) 2022 Challenge: Audio-Visual Diarization and Recognition

The Multi-modal Information based Speech Processing (MISP) challenge aim...

0 Zhe Wang, et al. ∙

research

∙ 03/08/2023

SEMv2: Table Separation Line Detection Based on Conditional Convolution

Table structure recognition is an indispensable element for enabling mac...

0 Zhenrong Zhang, et al. ∙

research

∙ 12/06/2022

Multimodal Tree Decoder for Table of Contents Extraction in Document Images

Table of contents (ToC) extraction aims to extract headings of different...

0 Pengfei Hu, et al. ∙

research

∙ 10/26/2022

Deep Learning Based Audio-Visual Multi-Speaker DOA Estimation Using Permutation-Free Loss Function

In this paper, we propose a deep learning based multi-speaker direction ...

0 Qing Wang, et al. ∙

research

∙ 03/25/2022

Multimodal Pre-training Based on Graph Attention Network for Document Understanding

Document intelligence as a relatively new research topic supports many b...

5 Zhenrong Zhang, et al. ∙

research

∙ 03/07/2022

A study on joint modeling and data augmentation of multi-modalities for audio-visual scene classification

In this paper, we propose two techniques, namely joint modeling and data...

10 Qing Wang, et al. ∙

research

∙ 02/17/2022

A Study of Designing Compact Audio-Visual Wake Word Spotting System Based on Iterative Fine-Tuning in Neural Network Pruning

Audio-only-based wake word spotting (WWS) is challenging under noisy con...

2 Hengshun Zhou, et al. ∙

research

∙ 02/10/2022

The USTC-Ximalaya system for the ICASSP 2022 multi-channel multi-party meeting transcription (M2MeT) challenge

We propose two improvements to target-speaker voice activity detection (...

1 Maokui He, et al. ∙

research

∙ 11/17/2021

Information Fusion in Attention Networks Using Adaptive and Multi-level Factorized Bilinear Pooling for Audio-visual Emotion Recognition

Multimodal emotion recognition is a challenging task in emotion computin...

0 Hengshun Zhou, et al. ∙

research

∙ 07/12/2021

Split, embed and merge: An accurate table structure recognizer

The task of table structure recognition is to recognize the internal str...

3 Zhenrong Zhang, et al. ∙

research

∙ 07/06/2021

Separation Guided Speaker Diarization in Realistic Mismatched Conditions

We propose a separation guided speaker diarization (SGSD) approach by fu...

0 Shu-Tong Niu, et al. ∙

research

∙ 07/03/2021

A Lottery Ticket Hypothesis Framework for Low-Complexity Device-Robust Neural Acoustic Scene Classification

We propose a novel neural model compression strategy combining data augm...

7 Chao-Han Huck Yang, et al. ∙

research

∙ 04/08/2021

AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenario

In this paper, we present AISHELL-4, a sizable real-recorded Mandarin sp...

0 Yihui Fu, et al. ∙

research

∙ 03/19/2021

USTC-NELSLIP System Description for DIHARD-III Challenge

This system description describes our submission system to the Third DIH...

5 Yuxuan Wang, et al. ∙

research

∙ 01/08/2021

A Four-Stage Data Augmentation Approach to ResNet-Conformer Based Acoustic Modeling for Sound Event Localization and Detection

In this paper, we propose a novel four-stage data augmentation approach ...

0 Qing Wang, et al. ∙

research

∙ 12/28/2020

Lip-reading with Hierarchical Pyramidal Convolution and Self-Attention

In this paper, we propose a novel deep learning architecture to improvin...

3 Hang Chen, et al. ∙

research

∙ 12/27/2020

Exploring Emotion Features and Fusion Strategies for Audio-Video Emotion Recognition

The audio-video based emotion recognition aims to classify a given video...

12 Hengshun Zhou, et al. ∙

research

∙ 12/02/2020

The Third DIHARD Diarization Challenge

This paper introduces the third DIHARD challenge, the third in a series ...

0 Neville Ryant, et al. ∙

research

∙ 11/08/2020

Frequency Gating: Improved Convolutional Neural Networks for Speech Enhancement in the Time-Frequency Domain

One of the strengths of traditional convolutional neural networks (CNNs)...

6 Koen Oostermeijer, et al. ∙

research

∙ 11/03/2020

Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis

Multi-speaker speech recognition of unsegmented recordings has diverse a...

0 Desh Raj, et al. ∙

research

∙ 11/03/2020

A Two-Stage Approach to Device-Robust Acoustic Scene Classification

To improve device robustness, a highly desirable key feature of a compet...

7 Hu Hu, et al. ∙

research

∙ 09/21/2020

Correlating Subword Articulation with Lip Shapes for Embedding Aware Audio-Visual Speech Enhancement

In this paper, we propose a visual embedding approach to improving embed...

0 Hang Chen, et al. ∙

research

∙ 08/12/2020

On Mean Absolute Error for Deep Neural Network Based Vector-to-Vector Regression

In this paper, we exploit the properties of mean absolute error (MAE) as...

0 Jun Qi, et al. ∙

research

∙ 08/04/2020

Analyzing Upper Bounds on Mean Absolute Errors for Deep Neural Network Based Vector-to-Vector Regression

In this paper, we show that, in vector-to-vector regression utilizing de...

0 Jun Qi, et al. ∙

research

∙ 07/31/2020

An Acoustic Segment Model Based Segment Unit Selection Approach to Acoustic Scene Classification with Partial Utterances

In this paper, we propose a sub-utterance unit selection framework to re...

0 Hu Hu, et al. ∙

research

∙ 07/16/2020

Device-Robust Acoustic Scene Classification Based on Two-Stage Categorization and Data Augmentation

In this technical report, we present a joint effort of four groups, name...

0 Hu Hu, et al. ∙

research

∙ 06/04/2020

Third DIHARD Challenge Evaluation Plan

This paper introduces the third DIHARD challenge, the third in a series ...

0 Neville Ryant, et al. ∙

research

∙ 02/20/2020

Stroke Constrained Attention Network for Online Handwritten Mathematical Expression Recognition

In this paper, we propose a novel stroke constrained attention network (...

0 Jiaming Wang, et al. ∙

research

∙ 01/01/2020

Attentive batch normalization for lstm-based acoustic modeling of speech recognition

Batch normalization (BN) is an effective method to accelerate model trai...

0 Fenglin Ding, et al. ∙

research

∙ 12/17/2019

Joint Architecture and Knowledge Distillation in Convolutional Neural Network for Offline Handwritten Chinese Text Recognition

The technique of distillation helps transform cumbersome neural network ...

0 Zi-Rui Wang, et al. ∙

research

∙ 12/02/2019

Speaker detection in the wild: Lessons learned from JSALT 2019

This paper presents the problems and solutions addressed at the JSALT wo...

0 Paola García, et al. ∙

research

∙ 06/22/2019

Adaptive Period Embedding for Representing Oriented Objects in Aerial Images

We propose a novel method for representing oriented objects in aerial im...

2 Yixing Zhu, et al. ∙

research

∙ 06/18/2019

The Second DIHARD Diarization Challenge: Dataset, task, and baselines

This paper introduces the second DIHARD challenge, the second in a serie...

0 Neville Ryant, et al. ∙

research

∙ 03/28/2019

Deep Neural Network Embeddings with Gating Mechanisms for Text-Independent Speaker Verification

In this paper, gating mechanisms are applied in deep neural network (DNN...

0 Lanhua You, et al. ∙

research

∙ 03/28/2019

Multi-Task Learning with High-Order Statistics for X-vector based Text-Independent Speaker Verification

The x-vector based deep neural network (DNN) embedding systems have demo...

0 Lanhua You, et al. ∙

research

∙ 03/28/2019

Deep Neural Network Embedding Learning with High-Order Statistics for Text-Independent Speaker Verification

The x-vector based deep neural network (DNN) embedding systems have demo...

0 Lanhua You, et al. ∙

research

∙ 01/15/2019

Deep Fusion: An Attention Guided Factorized Bilinear Pooling for Audio-video Emotion Recognition

Automatic emotion recognition (AER) is a challenging task due to the abs...

16 Yuanyuan Zhang, et al. ∙

research

∙ 12/24/2018

Writer-Aware CNN for Parsimonious HMM-Based Offline Handwritten Chinese Text Recognition

Recently, the hybrid convolutional neural network hidden Markov model (C...

0 Zi-Rui Wang, et al. ∙

research

∙ 11/30/2018

TextMountain: Accurate Scene Text Detection via Instance Segmentation

In this paper, we propose a novel scene text detection method named Text...

2 Yixing Zhu, et al. ∙

research

∙ 11/28/2018

Acoustics-guided evaluation (AGE): a new measure for estimating performance of speech enhancement algorithms for robust ASR

One challenging problem of robust automatic speech recognition (ASR) is ...

0 Li Chai, et al. ∙

research

∙ 08/13/2018

Parsimonious HMMs for Offline Handwritten Chinese Text Recognition

Recently, hidden Markov models (HMMs) have achieved promising results fo...

0 Wenchao Wang, et al. ∙

research

∙ 08/13/2018

DenseRAN for Offline Handwritten Chinese Character Recognition

Recently, great success has been achieved in offline handwritten Chinese...

0 Wenchao Wang, et al. ∙

Jun Du

Featured Co-authors