Learning to mirror speaking styles incrementally

03/05/2020
by   Siyi Liu, et al.
0

Mirroring is the behavior in which one person subconsciously imitates the gesture, speech pattern, or attitude of another. In conversations, mirroring often signals the speakers enjoyment and engagement in their communication. In chatbots, methods have been proposed to add personas to the chatbots and to train them to speak or to shift their dialogue style to that of the personas. However, they often require a large dataset consisting of dialogues of the target personalities to train. In this work, we explore a method that can learn to mirror the speaking styles of a person incrementally. Our method extracts ngrams that capture a persons speaking styles and uses the ngrams to create patterns for transforming sentences to the persons speaking styles. Our experiments show that our method is able to capture patterns of speaking style that can be used to transform regular sentences into sentences with the target style.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/15/2022

ZeroEGGS: Zero-shot Example-based Gesture Generation from Speech

We present ZeroEGGS, a neural network framework for speech-driven gestur...
research
04/04/2019

In Other News: A Bi-style Text-to-speech Model for Synthesizing Newscaster Voice with Limited Data

Neural text-to-speech synthesis (NTTS) models have shown significant pro...
research
10/24/2016

A Learned Representation For Artistic Style

The diversity of painting styles represents a rich visual vocabulary for...
research
06/21/2023

Analyzing Font Style Usage and Contextual Factors in Real Images

There are various font styles in the world. Different styles give differ...
research
06/11/2021

Spoken Style Learning with Multi-modal Hierarchical Context Encoding for Conversational Text-to-Speech Synthesis

For conversational text-to-speech (TTS) systems, it is vital that the sy...
research
04/03/2020

Towards Designer Modeling through Design Style Clustering

We propose modeling designer style in mixed-initiative game content crea...
research
07/18/2023

FACTS: Facial Animation Creation using the Transfer of Styles

The ability to accurately capture and express emotions is a critical asp...

Please sign up or login with your details

Forgot password? Click here to reset