research
∙
07/18/2023
How is ChatGPT's behavior changing over time?
GPT-3.5 and GPT-4 are the two most widely used large language model (LLM...
share
research
∙
05/09/2023
FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance
There is a rapidly growing number of large language models (LLMs) that u...
research
∙
10/11/2022
SEAL : Interactive Tool for Systematic Error Analysis and Labeling
With the advent of Transformers, large language models (LLMs) have satur...
research
∙
09/18/2022
HAPI: A Large-scale Longitudinal Dataset of Commercial ML API Predictions
Commercial ML APIs offered by providers such as Google, Amazon and Micro...
research
∙
09/18/2022
Estimating and Explaining Model Performance When Both Covariates and Labels Shift
Deployed machine learning (ML) models often encounter new user data that...
research
∙
10/04/2021
Solon: Communication-efficient Byzantine-resilient Distributed Training via Redundant Gradients
There has been a growing need to provide Byzantine-resilience in distrib...
research
∙
07/29/2021
Did the Model Change? Efficiently Assessing Machine Learning API Shifts
Machine learning (ML) prediction APIs are increasingly widely used. An M...
research
∙
02/18/2021
FrugalMCT: Efficient Online ML API Selection for Multi-Label Classification Tasks
Multi-label classification tasks such as OCR and multi-object recognitio...
research
∙
06/12/2020
FrugalML: How to Use ML Prediction APIs More Accurately and Cheaply
Prediction APIs offered for a fee are a fast-growing industry and an imp...
research
∙
06/11/2018
The Effect of Network Width on the Performance of Large-batch Training
Distributed implementations of mini-batch stochastic gradient descent (S...
research
∙
05/26/2018
Model-based Pricing for Machine Learning in a Data Marketplace
Data analytics using machine learning (ML) has become ubiquitous in scie...
research
∙
03/27/2018
DRACO: Robust Distributed Training via Redundant Gradients
Distributed model training is vulnerable to worst-case system failures a...
research
∙
11/21/2017
The Manifold Assumption and Defenses Against Adversarial Perturbations
In the adversarial-perturbation problem of neural networks, an adversary...
research
∙
11/21/2017
Manifold Assumption and Defenses Against Adversarial Perturbations
In the adversarial perturbation problem of neural networks, an adversary...
research
∙
02/22/2017