research
∙
09/17/2023
Continuous Modeling of the Denoising Process for Speech Enhancement Based on Deep Learning
In this paper, we explore a continuous modeling approach for deep-learni...
share
research
∙
09/17/2023
Neural Speaker Diarization Using Memory-Aware Multi-Speaker Embedding with Sequence-to-Sequence Architecture
We propose a novel neural speaker diarization system using memory-aware ...
research
∙
09/15/2023
The Multimodal Information Based Speech Processing (MISP) 2023 Challenge: Audio-Visual Target Speaker Extraction
Previous Multimodal Information based Speech Processing (MISP) challenge...
research
∙
08/28/2023
The USTC-NERCSLIP Systems for the CHiME-7 DASR Challenge
This technical report details our submission system to the CHiME-7 DASR ...
research
∙
08/14/2023
Improving Audio-Visual Speech Recognition by Lip-Subword Correlation Based Visual Pre-training and Cross-Modal Fusion Encoder
In recent research, slight performance improvement is observed from auto...
research
∙
07/30/2023
Count, Decode and Fetch: A New Approach to Handwritten Chinese Character Error Correction
Recently, handwritten Chinese character error correction has been greatl...
research
∙
06/14/2023
Variance-Preserving-Based Interpolation Diffusion Models for Speech Enhancement
The goal of this study is to implement diffusion models for speech enhan...
research
∙
03/24/2023
HRDoc: Dataset and Baseline Method Toward Hierarchical Reconstruction of Document Structures
The problem of document structure reconstruction refers to converting di...
research
∙
03/11/2023
The Multimodal Information based Speech Processing (MISP) 2022 Challenge: Audio-Visual Diarization and Recognition
The Multi-modal Information based Speech Processing (MISP) challenge aim...
research
∙
03/08/2023
SEMv2: Table Separation Line Detection Based on Conditional Convolution
Table structure recognition is an indispensable element for enabling mac...
research
∙
12/06/2022
Multimodal Tree Decoder for Table of Contents Extraction in Document Images
Table of contents (ToC) extraction aims to extract headings of different...
research
∙
10/26/2022
Deep Learning Based Audio-Visual Multi-Speaker DOA Estimation Using Permutation-Free Loss Function
In this paper, we propose a deep learning based multi-speaker direction ...
research
∙
03/25/2022
Multimodal Pre-training Based on Graph Attention Network for Document Understanding
Document intelligence as a relatively new research topic supports many b...
research
∙
03/07/2022
A study on joint modeling and data augmentation of multi-modalities for audio-visual scene classification
In this paper, we propose two techniques, namely joint modeling and data...
research
∙
02/17/2022
A Study of Designing Compact Audio-Visual Wake Word Spotting System Based on Iterative Fine-Tuning in Neural Network Pruning
Audio-only-based wake word spotting (WWS) is challenging under noisy con...
research
∙
02/10/2022
The USTC-Ximalaya system for the ICASSP 2022 multi-channel multi-party meeting transcription (M2MeT) challenge
We propose two improvements to target-speaker voice activity detection (...
research
∙
11/17/2021
Information Fusion in Attention Networks Using Adaptive and Multi-level Factorized Bilinear Pooling for Audio-visual Emotion Recognition
Multimodal emotion recognition is a challenging task in emotion computin...
research
∙
07/12/2021
Split, embed and merge: An accurate table structure recognizer
The task of table structure recognition is to recognize the internal str...
research
∙
07/06/2021
Separation Guided Speaker Diarization in Realistic Mismatched Conditions
We propose a separation guided speaker diarization (SGSD) approach by fu...
research
∙
07/03/2021
A Lottery Ticket Hypothesis Framework for Low-Complexity Device-Robust Neural Acoustic Scene Classification
We propose a novel neural model compression strategy combining data augm...
research
∙
04/08/2021
AISHELL-4: An Open Source Dataset for Speech Enhancement, Separation, Recognition and Speaker Diarization in Conference Scenario
In this paper, we present AISHELL-4, a sizable real-recorded Mandarin sp...
research
∙
03/19/2021
USTC-NELSLIP System Description for DIHARD-III Challenge
This system description describes our submission system to the Third DIH...
research
∙
01/08/2021
A Four-Stage Data Augmentation Approach to ResNet-Conformer Based Acoustic Modeling for Sound Event Localization and Detection
In this paper, we propose a novel four-stage data augmentation approach ...
research
∙
12/28/2020
Lip-reading with Hierarchical Pyramidal Convolution and Self-Attention
In this paper, we propose a novel deep learning architecture to improvin...
research
∙
12/27/2020
Exploring Emotion Features and Fusion Strategies for Audio-Video Emotion Recognition
The audio-video based emotion recognition aims to classify a given video...
research
∙
12/02/2020
The Third DIHARD Diarization Challenge
This paper introduces the third DIHARD challenge, the third in a series ...
research
∙
11/08/2020
Frequency Gating: Improved Convolutional Neural Networks for Speech Enhancement in the Time-Frequency Domain
One of the strengths of traditional convolutional neural networks (CNNs)...
research
∙
11/03/2020
Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis
Multi-speaker speech recognition of unsegmented recordings has diverse a...
research
∙
11/03/2020
A Two-Stage Approach to Device-Robust Acoustic Scene Classification
To improve device robustness, a highly desirable key feature of a compet...
research
∙
09/21/2020
Correlating Subword Articulation with Lip Shapes for Embedding Aware Audio-Visual Speech Enhancement
In this paper, we propose a visual embedding approach to improving embed...
research
∙
08/12/2020
On Mean Absolute Error for Deep Neural Network Based Vector-to-Vector Regression
In this paper, we exploit the properties of mean absolute error (MAE) as...
research
∙
08/04/2020
Analyzing Upper Bounds on Mean Absolute Errors for Deep Neural Network Based Vector-to-Vector Regression
In this paper, we show that, in vector-to-vector regression utilizing de...
research
∙
07/31/2020
An Acoustic Segment Model Based Segment Unit Selection Approach to Acoustic Scene Classification with Partial Utterances
In this paper, we propose a sub-utterance unit selection framework to re...
research
∙
07/16/2020
Device-Robust Acoustic Scene Classification Based on Two-Stage Categorization and Data Augmentation
In this technical report, we present a joint effort of four groups, name...
research
∙
06/04/2020
Third DIHARD Challenge Evaluation Plan
This paper introduces the third DIHARD challenge, the third in a series ...
research
∙
02/20/2020
Stroke Constrained Attention Network for Online Handwritten Mathematical Expression Recognition
In this paper, we propose a novel stroke constrained attention network (...
research
∙
01/01/2020
Attentive batch normalization for lstm-based acoustic modeling of speech recognition
Batch normalization (BN) is an effective method to accelerate model trai...
research
∙
12/17/2019
Joint Architecture and Knowledge Distillation in Convolutional Neural Network for Offline Handwritten Chinese Text Recognition
The technique of distillation helps transform cumbersome neural network ...
research
∙
12/02/2019
Speaker detection in the wild: Lessons learned from JSALT 2019
This paper presents the problems and solutions addressed at the JSALT wo...
research
∙
06/22/2019
Adaptive Period Embedding for Representing Oriented Objects in Aerial Images
We propose a novel method for representing oriented objects in aerial im...
research
∙
06/18/2019
The Second DIHARD Diarization Challenge: Dataset, task, and baselines
This paper introduces the second DIHARD challenge, the second in a serie...
research
∙
03/28/2019
Deep Neural Network Embeddings with Gating Mechanisms for Text-Independent Speaker Verification
In this paper, gating mechanisms are applied in deep neural network (DNN...
research
∙
03/28/2019
Multi-Task Learning with High-Order Statistics for X-vector based Text-Independent Speaker Verification
The x-vector based deep neural network (DNN) embedding systems have demo...
research
∙
03/28/2019
Deep Neural Network Embedding Learning with High-Order Statistics for Text-Independent Speaker Verification
The x-vector based deep neural network (DNN) embedding systems have demo...
research
∙
01/15/2019
Deep Fusion: An Attention Guided Factorized Bilinear Pooling for Audio-video Emotion Recognition
Automatic emotion recognition (AER) is a challenging task due to the abs...
research
∙
12/24/2018
Writer-Aware CNN for Parsimonious HMM-Based Offline Handwritten Chinese Text Recognition
Recently, the hybrid convolutional neural network hidden Markov model (C...
research
∙
11/30/2018
TextMountain: Accurate Scene Text Detection via Instance Segmentation
In this paper, we propose a novel scene text detection method named Text...
research
∙
11/28/2018
Acoustics-guided evaluation (AGE): a new measure for estimating performance of speech enhancement algorithms for robust ASR
One challenging problem of robust automatic speech recognition (ASR) is ...
research
∙
08/13/2018
Parsimonious HMMs for Offline Handwritten Chinese Text Recognition
Recently, hidden Markov models (HMMs) have achieved promising results fo...
research
∙
08/13/2018