On the Convergence of Tsetlin Machines for the IDENTITY- and NOT Operators

07/28/2020
by   Xuan Zhang, et al.
0

The Tsetlin Machine (TM) is a recent machine learning algorithm with several distinct properties, such as interpretability, simplicity, and hardware-friendliness. Although numerous empirical evaluations report on its performance, the mathematical analysis of its convergence is still open. In this article, we analyze the convergence of the TM with only one clause involved for classification. More specifically, we examine two basic logical operators, namely, the IDENTITY- and NOT operators. Our analysis reveals that the TM, with just one clause, can converge correctly to the intended logical operator, learning from training data over an infinite time horizon. Besides, it can capture arbitrarily rare patterns and select the most accurate one when two candidate patterns are incompatible, by configuring a granularity parameter. The analysis of the convergence of the two basic operators lays the foundation for analyzing other logical operators. These analyses altogether, from a mathematical perspective, provide new insights on why TMs have obtained state-of-the-art performance on several pattern recognition problems.

READ FULL TEXT

Authors

page 1

page 2

page 3

page 4

01/07/2021

On the Convergence of Tsetlin Machines for the XOR Operator

The Tsetlin Machine (TM) is a novel machine learning algorithm with seve...
09/17/2021

On the Convergence of Tsetlin Machines for the AND and the OR Operators

The Tsetlin Machine (TM) is a novel machine-learning algorithm based on ...
01/20/2019

A Universal Logic Operator for Interpretable Deep Convolution Networks

Explaining neural network computation in terms of probabilistic/fuzzy lo...
06/22/2022

Frugal Splitting Operators: Representation, Minimal Lifting and Convergence

We consider frugal splitting operators for finite sum monotone inclusion...
03/19/2018

Synthesis of Logical Clifford Operators via Symplectic Geometry

Quantum error-correcting codes can be used to protect qubits involved in...
10/16/2017

Dual Logic Concepts based on Mathematical Morphology in Stratified Institutions: Applications to Spatial Reasoning

Several logical operators are defined as dual pairs, in different types ...
09/26/2021

On some nonlocal models with radially symmetric interaction domains and the effect of domain truncation

Many nonlocal models have adopted a finite and radially symmetric nonloc...

Code Repositories

TsetlinMachine

The code and datasets for the Tsetlin Machine


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.