STUDIES: Corpus of Japanese Empathetic Dialogue Speech Towards Friendly Voice Agent

03/28/2022
by   Yuki Saito, et al.
0

We present STUDIES, a new speech corpus for developing a voice agent that can speak in a friendly manner. Humans naturally control their speech prosody to empathize with each other. By incorporating this "empathetic dialogue" behavior into a spoken dialogue system, we can develop a voice agent that can respond to a user more naturally. We designed the STUDIES corpus to include a speaker who speaks with empathy for the interlocutor's emotion explicitly. We describe our methodology to construct an empathetic dialogue speech corpus and report the analysis results of the STUDIES corpus. We conducted a text-to-speech experiment to initially investigate how we can develop more natural voice agent that can tune its speaking style corresponding to the interlocutor's emotion. The results show that the use of interlocutor's emotion label and conversational context embedding can produce speech with the same degree of naturalness as that synthesized by using the agent's emotion label. Our project page of the STUDIES corpus is http://sython.org/Corpus/STUDIES.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/23/2023

CALLS: Japanese Empathetic Dialogue Speech Corpus of Complaint Handling and Attentive Listening in Customer Center

We present CALLS, a Japanese speech corpus that considers phone calls in...
research
11/22/2021

Human-Machine Interaction Speech Corpus from the ROBIN project

This paper introduces a new Romanian speech corpus from the ROBIN projec...
research
05/02/2022

How does a spontaneously speaking conversational agent affect user behavior?

This study investigated the effect of synthetic voice of conversational ...
research
12/07/2022

Analysis and Utilization of Entrainment on Acoustic and Emotion Features in User-agent Dialogue

Entrainment is the phenomenon by which an interlocutor adapts their spea...
research
08/09/2022

Positively transitioned sentiment dialogue corpus for developing emotion-affective open-domain chatbots

In this paper, we describe a data enhancement method for developing Emil...
research
08/25/2011

Une analyse basée sur la S-DRT pour la modélisation de dialogues pathologiques

In this article, we present a corpus of dialogues between a schizophreni...
research
05/23/2023

ChatGPT-EDSS: Empathetic Dialogue Speech Synthesis Trained from ChatGPT-derived Context Word Embeddings

We propose ChatGPT-EDSS, an empathetic dialogue speech synthesis (EDSS) ...

Please sign up or login with your details

Forgot password? Click here to reset