On the Functional Equivalence of TSK Fuzzy Systems to Neural Networks, Mixture of Experts, CART, and Stacking Ensemble Regression

03/25/2019
by   Dongrui Wu, et al.
0

Fuzzy systems have achieved great success in numerous applications. However, there are still many challenges in designing an optimal fuzzy system, e.g., how to efficiently train its parameters, how to improve its performance without adding too many parameters, how to balance the trade-off between cooperations and competitions among the rules, how to overcome the curse of dimensionality, etc. Literature has shown that by making appropriate connections between fuzzy systems and other machine learning approaches, good practices from other domains may be used to improve the fuzzy systems, and vice versa. This paper gives an overview on the functional equivalence between Takagi-Sugeno-Kang fuzzy systems and four classic machine learning approaches -- neural networks, mixture of experts, classification and regression trees, and stacking ensemble regression -- for regression problems. We also point out some promising new research directions, inspired by the functional equivalence, that could lead to solutions to the aforementioned problems. To our knowledge, this is so far the most comprehensive overview on the connections between fuzzy systems and other popular machine learning approaches, and hopefully will stimulate more hybridization between different machine learning algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/26/2019

Optimize TSK Fuzzy Systems for Big Data Regression Problems: Mini-Batch Gradient Descent with Regularization, DropRule and AdaBound (MBGD-RDA)

Takagi-Sugeno-Kang (TSK) fuzzy systems are very useful machine learning ...
research
07/31/2019

A comparative study of general fuzzy min-max neural networks for pattern classification problems

General fuzzy min-max (GFMM) neural network is a generalization of fuzzy...
research
01/16/2019

Optimization Models for Machine Learning: A Survey

This paper surveys the machine learning literature and presents machine ...
research
08/01/2019

Optimize TSK Fuzzy Systems for Big Data Classification Problems: Bag of Tricks

Takagi-Sugeno-Kang (TSK) fuzzy systems are flexible and interpretable ma...
research
02/08/2021

Curse of Dimensionality for TSK Fuzzy Neural Networks: Explanation and Solutions

Takagi-Sugeno-Kang (TSK) fuzzy system with Gaussian membership functions...
research
04/18/2012

Fuzzy Dynamical Genetic Programming in XCSF

A number of representation schemes have been presented for use within Le...
research
08/28/2020

Comparison Between Genetic Fuzzy Methodology and Q-learning for Collaborative Control Design

A comparison between two machine learning approaches viz., Genetic Fuzzy...

Please sign up or login with your details

Forgot password? Click here to reset