FROTE: Feedback Rule-Driven Oversampling for Editing Models

01/04/2022
by   Oznur Alkan, et al.
9

Machine learning models may involve decision boundaries that change over time due to updates to rules and regulations, such as in loan approvals or claims management. However, in such scenarios, it may take time for sufficient training data to accumulate in order to retrain the model to reflect the new decision boundaries. While work has been done to reinforce existing decision boundaries, very little has been done to cover these scenarios where decision boundaries of the ML models should change in order to reflect new rules. In this paper, we focus on user-provided feedback rules as a way to expedite the ML models update process, and we formally introduce the problem of pre-processing training data to edit an ML model in response to feedback rules such that once the model is retrained on the pre-processed data, its decision boundaries align more closely with the rules. To solve this problem, we propose a novel data augmentation method, the Feedback Rule-Based Oversampling Technique. Extensive experiments using different ML models and real world datasets demonstrate the effectiveness of the method, in particular the benefit of augmentation and the ability to handle many feedback rules.

READ FULL TEXT

page 19

page 21

research
03/28/2022

User Driven Model Adjustment via Boolean Rule Explanations

AI solutions are heavily dependant on the quality and accuracy of the in...
research
05/20/2022

ExMo: Explainable AI Model using Inverse Frequency Decision Rules

In this paper, we present a novel method to compute decision rules to bu...
research
07/28/2023

FeedbackLogs: Recording and Incorporating Stakeholder Feedback into Machine Learning Pipelines

Even though machine learning (ML) pipelines affect an increasing array o...
research
07/18/2019

User-Interactive Machine Learning Model for Identifying Structural Relationships of Code Features

Traditional machine learning based intelligent systems assist users by l...
research
11/12/2019

RuleVis: Constructing Patterns and Rules for Rule-Based Models

We introduce RuleVis, a web-based application for defining and editing "...
research
06/14/2021

Controlling Neural Networks with Rule Representations

We propose a novel training method to integrate rules into deep learning...
research
03/14/2022

Closing the Loop: A Framework for Trustworthy Machine Learning in Power Systems

Deep decarbonization of the energy sector will require massive penetrati...

Please sign up or login with your details

Forgot password? Click here to reset