research
∙
06/14/2023
Tagged End-to-End Simultaneous Speech Translation Training using Simultaneous Interpretation Data
Simultaneous speech translation (SimulST) translates partial speech inpu...
share
research
∙
05/26/2023
Inter-connection: Effective Connection between Pre-trained Encoder and Decoder for Speech Translation
In end-to-end speech translation, speech and text pre-trained models imp...
research
∙
05/19/2023
Arukikata Travelogue Dataset
We have constructed Arukikata Travelogue Dataset and released it free of...
research
∙
04/23/2023
NAIST-SIC-Aligned: Automatically-Aligned English-Japanese Simultaneous Interpretation Corpus
It remains a question that how simultaneous interpretation (SI) data aff...
research
∙
03/07/2023
Sketch-based Medical Image Retrieval
The amount of medical images stored in hospitals is increasing faster th...
research
∙
03/01/2023
Modeling Multiple User Interests using Hierarchical Knowledge for Conversational Recommender System
A conversational recommender system (CRS) is a practical application for...
research
∙
02/15/2023
Whats New? Identifying the Unfolding of New Events in Narratives
Narratives include a rich source of events unfolding over time and conte...
research
∙
02/11/2023
Evaluating the Robustness of Discrete Prompts
Discrete prompts have been used for fine-tuning Pre-trained Language Mod...
research
∙
01/08/2023
SpeeChain: A Speech Toolkit for Large-Scale Machine Speech Chain
This paper introduces SpeeChain, an open-source Pytorch-based toolkit de...
research
∙
11/22/2022
Average Token Delay: A Latency Metric for Simultaneous Translation
Simultaneous translation is a task in which translation begins before th...
research
∙
11/01/2022
E2E Refined Dataset
Although the well-known MR-to-text E2E dataset has been used by many res...
research
∙
10/24/2022
Subspace-based Set Operations on a Pre-trained Word Embedding Space
Word embedding is a fundamental technology in natural language processin...
research
∙
08/27/2022
Actor-identified Spatiotemporal Action Detection – Detecting Who Is Doing What in Videos
The success of deep learning on video Action Recognition (AR) has motiva...
research
∙
08/12/2022
USB: A Unified Semi-supervised Learning Benchmark
Semi-supervised learning (SSL) improves model generalization by leveragi...
research
∙
06/01/2022
Speech Artifact Removal from EEG Recordings of Spoken Word Production with Tensor Decomposition
Research about brain activities involving spoken word production is cons...
research
∙
05/14/2022
Improved Consistency Training for Semi-Supervised Sequence-to-Sequence ASR via Speech Chain Reconstruction and Self-Transcribing
Consistency regularization has recently been applied to semi-supervised ...
research
∙
03/29/2022
Representing `how you say' with `what you say': English corpus of focused speech and text reflecting corresponding implications
In speech communication, how something is said (paralinguistic informati...
research
∙
03/29/2022
Speech Segmentation Optimization using Segmented Bilingual Speech Corpus for End-to-end Speech Translation
Speech segmentation, which splits long speech into short segments, is es...
research
∙
03/29/2022
Applying Syntaxx2013Prosody Mapping Hypothesis and Prosodic Well-Formedness Constraints to Neural Sequence-to-Sequence Speech Synthesis
End-to-end text-to-speech synthesis (TTS), which generates speech sounds...
research
∙
10/26/2021
Simultaneous Neural Machine Translation with Constituent Label Prediction
Simultaneous translation is a task in which translation begins before th...
research
∙
07/29/2021
Using Perturbed Length-aware Positional Encoding for Non-autoregressive Neural Machine Translation
Non-autoregressive neural machine translation (NAT) usually employs sequ...
research
∙
06/15/2021
ARTA: Collection and Classification of Ambiguous Requests and Thoughtful Actions
Human-assisting systems such as dialogue systems must take thoughtful, a...
research
∙
11/10/2020
Simultaneous Speech-to-Speech Translation System with Neural Incremental ASR, MT, and TTS
This paper presents a newly developed, simultaneous neural speech-to-spe...
research
∙
11/04/2020
Cross-Lingual Machine Speech Chain for Javanese, Sundanese, Balinese, and Bataks Speech Recognition and Synthesis
Even though over seven hundred ethnic languages are spoken in Indonesia,...
research
∙
11/04/2020
Sequence-to-Sequence Learning via Attention Transfer for Incremental Speech Recognition
Attention-based sequence-to-sequence automatic speech recognition (ASR) ...
research
∙
11/04/2020
Incremental Machine Speech Chain Towards Enabling Listening while Speaking in Real-time
Inspired by a human speech chain mechanism, a machine speech chain frame...
research
∙
11/04/2020
Augmenting Images for ASR and TTS through Single-loop and Dual-loop Multimodal Chain Framework
Previous research has proposed a machine speech chain to enable automati...
research
∙
10/19/2020
Image Captioning with Visual Object Representations Grounded in the Textual Modality
We present our work in progress exploring the possibilities of a shared ...
research
∙
07/07/2020
ReMOTS: Self-Supervised Refining Multi-Object Tracking and Segmentation
We aim to improve the performance of Multiple Object Tracking and Segmen...
research
∙
07/07/2020
ReMOTS: Refining Multi-Object Tracking and Segmentation
We aim to improve the performance of Multiple Object Tracking and Segmen...
research
∙
07/06/2020
Reflection-based Word Attribute Transfer
Word embeddings, which often represent such analogic relations as king -...
research
∙
05/24/2020
Transformer VQ-VAE for Unsupervised Unit Discovery and Speech Synthesis: ZeroSpeech 2020 Challenge
In this paper, we report our submitted system for the ZeroSpeech 2020 ch...
research
∙
03/23/2020
Caption Generation of Robot Behaviors based on Unsupervised Learning of Action Segments
Bridging robot action sequences and their natural language captions is a...
research
∙
11/27/2019
Simultaneous Neural Machine Translation using Connectionist Temporal Classification
Simultaneous machine translation is a variant of machine translation tha...
research
∙
11/24/2019
Using panoramic videos for multi-person localization and tracking in a 3D panoramic coordinate
This work proposes a new human-related video processing task named 3D pa...
research
∙
10/23/2019
Deja-vu: Double Feature Presentation in Deep Transformer Networks
Deep acoustic models typically receive features in the first layer of th...
research
∙
10/02/2019
Speech-to-speech Translation between Untranscribed Unknown Languages
In this paper, we explore a method for training speech-to-speech transla...
research
∙
07/23/2019
Make Skeleton-based Action Recognition Model Smaller, Faster and Better
Although skeleton-based action recognition has achieved great success in...
research
∙
06/24/2019
Conversational Response Re-ranking Based on Event Causality and Role Factored Tensor Event Embedding
We propose a novel method for selecting coherent and diverse responses f...
research
∙
06/03/2019
From Speech Chain to Multimodal Chain: Leveraging Cross-modal Data Augmentation for Semi-supervised Learning
The most common way for humans to communicate is by speech. But perhaps ...
research
∙
05/28/2019
An Incremental Turn-Taking Model For Task-Oriented Dialog Systems
In a human-machine dialog scenario, deciding the appropriate time for th...
research
∙
05/27/2019
VQVAE Unsupervised Unit Discovery and Multi-scale Code2Spec Inverter for Zerospeech Challenge 2019
We describe our submitted system for the ZeroSpeech Challenge 2019. The ...
research
∙
11/26/2018
Optimization of Information-Seeking Dialogue Strategy for Argumentation-Based Dialogue System
Argumentation-based dialogue systems, which can handle and exchange argu...
research
∙
11/20/2018
Another Diversity-Promoting Objective Function for Neural Dialogue Generation
Although generation-based dialogue systems have been widely researched, ...
research
∙
10/31/2018
End-to-End Feedback Loss in Speech Chain Framework via Straight-Through Estimator
The speech chain mechanism integrates automatic speech recognition (ASR)...
research
∙
10/16/2018
Multi-Source Neural Machine Translation with Data Augmentation
Multi-source translation systems translate from multiple languages to a ...
research
∙
07/30/2018
Training Neural Machine Translation using Word Embedding-based Loss
In neural machine translation (NMT), the computational cost at the outpu...
research
∙
07/22/2018
Multi-scale Alignment and Contextual History for Attention Mechanism in Sequence-to-sequence Model
A sequence-to-sequence model is a neural network module for mapping two ...
research
∙
06/07/2018
Multi-Source Neural Machine Translation with Missing Data
Multi-source translation is an approach to exploit multiple inputs (e.g....
research
∙
04/07/2018