Layered Logic Classifiers: Exploring the `And' and `Or' Relations

05/27/2014
by   Zhuowen Tu, et al.
0

Designing effective and efficient classifier for pattern analysis is a key problem in machine learning and computer vision. Many the solutions to the problem require to perform logic operations such as `and', `or', and `not'. Classification and regression tree (CART) include these operations explicitly. Other methods such as neural networks, SVM, and boosting learn/compute a weighted sum on features (weak classifiers), which weakly perform the 'and' and 'or' operations. However, it is hard for these classifiers to deal with the 'xor' pattern directly. In this paper, we propose layered logic classifiers for patterns of complicated distributions by combining the `and', `or', and `not' operations. The proposed algorithm is very general and easy to implement. We test the classifiers on several typical datasets from the Irvine repository and two challenging vision applications, object segmentation and pedestrian detection. We observe significant improvements on all the datasets over the widely used decision stump based AdaBoost algorithm. The resulting classifiers have much less training complexity than decision tree based AdaBoost, and can be applied in a wide range of domains.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/24/2021

Learning Multi-Layered GBDT Via Back Propagation

Deep neural networks are able to learn multi-layered representation via ...
research
05/31/2018

Multi-Layered Gradient Boosting Decision Trees

Multi-layered representation is believed to be the key ingredient of dee...
research
10/24/2022

An Acoustical Machine Learning Approach to Determine Abrasive Belt Wear of Wide Belt Sanders

This paper describes a machine learning approach to determine the abrasi...
research
08/02/2023

When Analytic Calculus Cracks AdaBoost Code

The principle of boosting in supervised learning involves combining mult...
research
06/09/2011

Inducing Interpretable Voting Classifiers without Trading Accuracy for Simplicity: Theoretical Results, Approximation Algorithms

Recent advances in the study of voting classification algorithms have br...
research
12/20/2018

Efficient logic architecture in training gradient boosting decision tree for high-performance and edge computing

This study proposes a logic architecture for the high-speed and power ef...
research
04/05/2020

Dynamic Decision Boundary for One-class Classifiers applied to non-uniformly Sampled Data

A typical issue in Pattern Recognition is the non-uniformly sampled data...

Please sign up or login with your details

Forgot password? Click here to reset