Resonance: Replacing Software Constants with Context-Aware Models in Real-time Communication

11/23/2020
by   Jayant Gupchup, et al.
12

Large software systems tune hundreds of 'constants' to optimize their runtime performance. These values are commonly derived through intuition, lab tests, or A/B tests. A 'one-size-fits-all' approach is often sub-optimal as the best value depends on runtime context. In this paper, we provide an experimental approach to replace constants with learned contextual functions for Skype - a widely used real-time communication (RTC) application. We present Resonance, a system based on contextual bandits (CB). We describe experiences from three real-world experiments: applying it to the audio, video, and transport components in Skype. We surface a unique and practical challenge of performing machine learning (ML) inference in large software systems written using encapsulation principles. Finally, we open-source FeatureBroker, a library to reduce the friction in adopting ML models in such development environments

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 2

03/06/2021

On the experiences of adopting automated data validation in an industrial machine learning project

Background: Data errors are a common challenge in machine learning (ML) ...
03/03/2021

A Survey for Real-Time Network Performance Measurement via Machine Learning

Real-Time Networks (RTNs) provide latency guarantees for time-critical a...
12/08/2014

MLitB: Machine Learning in the Browser

With few exceptions, the field of Machine Learning (ML) research has lar...
05/11/2018

The risk of sub-optimal use of Open Source NLP Software: UKB is inadvertently state-of-the-art in knowledge-based WSD

UKB is an open source collection of programs for performing, among other...
03/17/2021

Extending SOUP to ML Models When DesigningCertified Medical Systems

Software of Unknown Provenance, SOUP, refers to a software component tha...
06/12/2020

The Collective Knowledge project: making ML models more portable and reproducible with open APIs, reusable best practices and MLOps

This article provides an overview of the Collective Knowledge technology...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.