The design and implementation of Language Learning Chatbot with XAI using Ontology and Transfer Learning

09/29/2020
by   Nuobei Shi, et al.
0

In this paper, we proposed a transfer learning-based English language learning chatbot, whose output generated by GPT-2 can be explained by corresponding ontology graph rooted by fine-tuning dataset. We design three levels for systematically English learning, including phonetics level for speech recognition and pronunciation correction, semantic level for specific domain conversation, and the simulation of free-style conversation in English - the highest level of language chatbot communication as free-style conversation agent. For academic contribution, we implement the ontology graph to explain the performance of free-style conversation, following the concept of XAI (Explainable Artificial Intelligence) to visualize the connections of neural network in bionics, and explain the output sentence from language model. From implementation perspective, our Language Learning agent integrated the mini-program in WeChat as front-end, and fine-tuned GPT-2 model of transfer learning as back-end to interpret the responses by ontology graph.

READ FULL TEXT

page 1

page 4

page 14

page 15

page 19

research
09/22/2022

Prompting for a conversation: How to control a dialog model?

Dialog modelling faces a difficult trade-off. Models are trained on a la...
research
06/03/2020

Transfer Learning for British Sign Language Modelling

Automatic speech recognition and spoken dialogue systems have made great...
research
07/14/2023

Understanding Multi-Turn Toxic Behaviors in Open-Domain Chatbots

Recent advances in natural language processing and machine learning have...
research
10/12/2021

Småprat: DialoGPT for Natural Language Generation of Swedish Dialogue by Transfer Learning

Building open-domain conversational systems (or chatbots) that produce c...
research
02/03/2023

Witscript: A System for Generating Improvised Jokes in a Conversation

A chatbot is perceived as more humanlike and likeable if it includes som...
research
09/15/2023

ICLEF: In-Context Learning with Expert Feedback for Explainable Style Transfer

While state-of-the-art language models excel at the style transfer task,...

Please sign up or login with your details

Forgot password? Click here to reset