EasyMLServe: Easy Deployment of REST Machine Learning Services

11/26/2022
by   Oliver Neumann, et al.
0

Various research domains use machine learning approaches because they can solve complex tasks by learning from data. Deploying machine learning models, however, is not trivial and developers have to implement complete solutions which are often installed locally and include Graphical User Interfaces (GUIs). Distributing software to various users on-site has several problems. Therefore, we propose a concept to deploy software in the cloud. There are several frameworks available based on Representational State Transfer (REST) which can be used to implement cloud-based machine learning services. However, machine learning services for scientific users have special requirements that state-of-the-art REST frameworks do not cover completely. We contribute an EasyMLServe software framework to deploy machine learning services in the cloud using REST interfaces and generic local or web-based GUIs. Furthermore, we apply our framework on two real-world applications, , energy time-series forecasting and cell instance segmentation. The EasyMLServe framework and the use cases are available on GitHub.

READ FULL TEXT

page 13

page 15

research
10/08/2018

NSML: Meet the MLaaS platform with a real-world case study

The boom of deep learning induced many industries and academies to intro...
research
02/29/2020

FlexServe: Deployment of PyTorch Models as Flexible REST Endpoints

The integration of artificial intelligence capabilities into modern soft...
research
04/27/2022

Generating Examples From CLI Usage: Can Transformers Help?

Continuous evolution in modern software often causes documentation, tuto...
research
11/18/2020

Challenges in Deploying Machine Learning: a Survey of Case Studies

In recent years, machine learning has received increased interest both a...
research
03/10/2020

REST vs GraphQL: A Controlled Experiment

GraphQL is a novel query language for implementing service-based softwar...
research
05/18/2020

A Link Generator for Increasing the Utility of OpenAPI-to-GraphQL Translations

Standardized interfaces are the connecting link of today's distributed s...
research
04/18/2021

Small-Scale 5G Testbeds for Network Slicing Deployment: A Systematic Review

Developing specialized cloud-based and open-source testbeds is a practic...

Please sign up or login with your details

Forgot password? Click here to reset