The Stochastic Replica Approach to Machine Learning: Stability and Parameter Optimization

08/18/2017
by   Patrick Chao, et al.
0

We introduce a statistical physics inspired supervised machine learning algorithm for classification and regression problems. The method is based on the invariances or stability of predicted results when known data is represented as expansions in terms of various stochastic functions. The algorithm predicts the classification/regression values of new data by combining (via voting) the outputs of these numerous linear expansions in randomly chosen functions. The few parameters (typically only one parameter is used in all studied examples) that this model has may be automatically optimized. The algorithm has been tested on 10 diverse training data sets of various types and feature space dimensions. It has been shown to consistently exhibit high accuracy and readily allow for optimization of parameters, while simultaneously avoiding pitfalls of existing algorithms such as those associated with class imbalance. We very briefly speculate on whether spatial coordinates in physical theories may be viewed as emergent "features" that enable a robust machine learning type description of data with generic low order smooth functions.

READ FULL TEXT

page 4

page 7

page 19

research
10/02/2020

Explainable Online Validation of Machine Learning Models for Practical Applications

We present a reformulation of the regression and classification, which a...
research
11/04/2022

Impact Learning: A Learning Method from Features Impact and Competition

Machine learning is the study of computer algorithms that can automatica...
research
10/28/2020

Continuous Lyapunov Controller and Chaotic Non-linear System Optimization using Deep Machine Learning

The introduction of unexpected system disturbances and new system dynami...
research
07/23/2023

A Machine Learning Approach to Two-Stage Adaptive Robust Optimization

We propose an approach based on machine learning to solve two-stage line...
research
11/17/2021

A Note on Simulation-Based Inference by Matching Random Features

We can, and should, do statistical inference on simulation models by adj...
research
06/08/2021

Hybrid Method Based on NARX models and Machine Learning for Pattern Recognition

This work presents a novel technique that integrates the methodologies o...
research
02/12/2020

Connecting Dualities and Machine Learning

Dualities are widely used in quantum field theories and string theory to...

Please sign up or login with your details

Forgot password? Click here to reset