Learning to mirror speaking styles incrementally

by   Siyi Liu, et al.

Mirroring is the behavior in which one person subconsciously imitates the gesture, speech pattern, or attitude of another. In conversations, mirroring often signals the speakers enjoyment and engagement in their communication. In chatbots, methods have been proposed to add personas to the chatbots and to train them to speak or to shift their dialogue style to that of the personas. However, they often require a large dataset consisting of dialogues of the target personalities to train. In this work, we explore a method that can learn to mirror the speaking styles of a person incrementally. Our method extracts ngrams that capture a persons speaking styles and uses the ngrams to create patterns for transforming sentences to the persons speaking styles. Our experiments show that our method is able to capture patterns of speaking style that can be used to transform regular sentences into sentences with the target style.


page 1

page 2

page 3

page 4


ZeroEGGS: Zero-shot Example-based Gesture Generation from Speech

We present ZeroEGGS, a neural network framework for speech-driven gestur...

In Other News: A Bi-style Text-to-speech Model for Synthesizing Newscaster Voice with Limited Data

Neural text-to-speech synthesis (NTTS) models have shown significant pro...

A Learned Representation For Artistic Style

The diversity of painting styles represents a rich visual vocabulary for...

Analyzing Font Style Usage and Contextual Factors in Real Images

There are various font styles in the world. Different styles give differ...

Spoken Style Learning with Multi-modal Hierarchical Context Encoding for Conversational Text-to-Speech Synthesis

For conversational text-to-speech (TTS) systems, it is vital that the sy...

Towards Designer Modeling through Design Style Clustering

We propose modeling designer style in mixed-initiative game content crea...

FACTS: Facial Animation Creation using the Transfer of Styles

The ability to accurately capture and express emotions is a critical asp...

Please sign up or login with your details

Forgot password? Click here to reset