DeepAI AI Chat
Log In Sign Up

Neural model robustness for skill routing in large-scale conversational AI systems: A design choice exploration

03/04/2021
by   Han Li, et al.
0

Current state-of-the-art large-scale conversational AI or intelligent digital assistant systems in industry comprises a set of components such as Automatic Speech Recognition (ASR) and Natural Language Understanding (NLU). For some of these systems that leverage a shared NLU ontology (e.g., a centralized intent/slot schema), there exists a separate skill routing component to correctly route a request to an appropriate skill, which is either a first-party or third-party application that actually executes on a user request. The skill routing component is needed as there are thousands of skills that can either subscribe to the same intent and/or subscribe to an intent under specific contextual conditions (e.g., device has a screen). Ensuring model robustness or resilience in the skill routing component is an important problem since skills may dynamically change their subscription in the ontology after the skill routing model has been deployed to production. We show how different modeling design choices impact the model robustness in the context of skill routing on a state-of-the-art commercial conversational AI system, specifically on the choices around data augmentation, model architecture, and optimization method. We show that applying data augmentation can be a very effective and practical way to drastically improve model robustness.

READ FULL TEXT

page 1

page 2

page 3

page 4

04/14/2022

Scalable and Robust Self-Learning for Skill Routing in Large-Scale Conversational AI Systems

Skill routing is an important component in large-scale conversational sy...
10/23/2022

BotsTalk: Machine-sourced Framework for Automatic Curation of Large-scale Multi-skill Dialogue Datasets

To build open-domain chatbots that are able to use diverse communicative...
11/15/2019

Towards Personalized Dialog Policies for Conversational Skill Discovery

Many businesses and consumers are extending the capabilities of voice-ba...
06/25/2020

Neural Machine Translation For Paraphrase Generation

Training a spoken language understanding system, as the one in Alexa, ty...
04/30/2020

Learning to Rank Intents in Voice Assistants

Voice Assistants aim to fulfill user requests by choosing the best inten...
04/29/2022

Self-Aware Feedback-Based Self-Learning in Large-Scale Conversational AI

Self-learning paradigms in large-scale conversational AI agents tend to ...