Bridging the Gap: Simultaneous Fine Tuning for Data Re-Balancing

01/08/2018
by   John McKay, et al.
0

There are many real-world classification problems wherein the issue of data imbalance (the case when a data set contains substantially more samples for one/many classes than the rest) is unavoidable. While under-sampling the problematic classes is a common solution, this is not a compelling option when the large data class is itself diverse and/or the limited data class is especially small. We suggest a strategy based on recent work concerning limited data problems which utilizes a supplemental set of images with similar properties to the limited data class to aid in the training of a neural network. We show results for our model against other typical methods on a real-world synthetic aperture sonar data set. Code can be found at github.com/JohnMcKay/dataImbalance.

READ FULL TEXT
research
07/22/2022

Two-Stage Fine-Tuning: A Novel Strategy for Learning Class-Imbalanced Data

Classification on long-tailed distributed data is a challenging problem,...
research
07/19/2022

Adaptive Learning for the Resource-Constrained Classification Problem

Resource-constrained classification tasks are common in real-world appli...
research
11/16/2019

An "outside the box" solution for imbalanced data classification

A common problem of the real-world data sets is the class imbalance, whi...
research
10/09/2020

Addressing the Real-world Class Imbalance Problem in Dermatology

Class imbalance is a common problem in medical diagnosis, causing a stan...
research
09/23/2020

I-SiamIDS: an improved Siam-IDS for handling class imbalance in network-based intrusion detection systems

NIDSs identify malicious activities by analyzing network traffic. NIDSs ...
research
07/21/2022

Explainable AI Algorithms for Vibration Data-based Fault Detection: Use Case-adadpted Methods and Critical Evaluation

Analyzing vibration data using deep neural network algorithms is an effe...
research
09/29/2020

Efficient SVDD Sampling with Approximation Guarantees for the Decision Boundary

Support Vector Data Description (SVDD) is a popular one-class classifier...

Please sign up or login with your details

Forgot password? Click here to reset