Re-framing Incremental Deep Language Models for Dialogue Processing with Multi-task Learning

11/13/2020
by   Morteza Rohanian, et al.
0

We present a multi-task learning framework to enable the training of one universal incremental dialogue processing model with four tasks of disfluency detection, language modelling, part-of-speech tagging, and utterance segmentation in a simple deep recurrent setting. We show that these tasks provide positive inductive biases to each other with the optimal contribution of each one relying on the severity of the noise from the task. Our live multi-task model outperforms similar individual tasks, delivers competitive performance, and is beneficial for future use in conversational agents in psychiatric treatment.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

01/27/2021

Language Modelling as a Multi-Task Problem

In this paper, we propose to study language modelling as a multi-task pr...
05/07/2021

SpeechNet: A Universal Modularized Model for Speech Processing Tasks

There is a wide variety of speech processing tasks ranging from extracti...
10/08/2018

Multi-Task Learning for Domain-General Spoken Disfluency Detection in Dialogue Systems

Spontaneous spoken dialogue is often disfluent, containing pauses, hesit...
03/29/2021

CaSiNo: A Corpus of Campsite Negotiation Dialogues for Automatic Negotiation Systems

Automated systems that negotiate with humans have broad applications in ...
03/27/2022

Reinforcement Guided Multi-Task Learning Framework for Low-Resource Stereotype Detection

As large Pre-trained Language Models (PLMs) trained on large amounts of ...
12/05/2020

Deep Multi-task Learning for Depression Detection and Prediction in Longitudinal Data

Depression is among the most prevalent mental disorders, affecting milli...
02/01/2022

Multi-Order Networks for Action Unit Detection

Deep multi-task methods, where several tasks are learned within a single...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.