DeepAI AI Chat
Log In Sign Up

Practical Insights of Repairing Model Problems on Image Classification

by   Akihito Yoshii, et al.
National Institute of Informatics

Additional training of a deep learning model can cause negative effects on the results, turning an initially positive sample into a negative one (degradation). Such degradation is possible in real-world use cases due to the diversity of sample characteristics. That is, a set of samples is a mixture of critical ones which should not be missed and less important ones. Therefore, we cannot understand the performance by accuracy alone. While existing research aims to prevent a model degradation, insights into the related methods are needed to grasp their benefits and limitations. In this talk, we will present implications derived from a comparison of methods for reducing degradation. Especially, we formulated use cases for industrial settings in terms of arrangements of a data set. The results imply that a practitioner should care about better method continuously considering dataset availability and life cycle of an AI system because of a trade-off between accuracy and preventing degradation.


page 1

page 2


Crafting Training Degradation Distribution for the Accuracy-Generalization Trade-off

Super-resolution (SR) techniques designed for real-world applications co...

Stuttgart Open Relay Degradation Dataset (SOReDD)

Real-life industrial use cases for machine learning oftentimes involve h...

Learning degraded image classification with restoration data fidelity

Learning-based methods especially with convolutional neural networks (CN...

Positive-Congruent Training: Towards Regression-Free Model Updates

Reducing inconsistencies in the behavior of different versions of an AI ...

The impact of Use Cases in real-world software development projects: A systematic mapping study

Objective: To identify and classify the positive and negative impacts of...

Track Geometry Degradation Modelling Considering Multiple Indicators

Railway infrastructure requires effective maintenance to ensure safe and...

A note on efficient audit sample selection

Auditing is a widely used method for quality improvement, and many guide...