Improving text classification with vectors of reduced precision

06/20/2017
by   Krzysztof Wróbel, et al.
0

This paper presents the analysis of the impact of a floating-point number precision reduction on the quality of text classification. The precision reduction of the vectors representing the data (e.g. TF-IDF representation in our case) allows for a decrease of computing time and memory footprint on dedicated hardware platforms. The impact of precision reduction on the classification quality was performed on 5 corpora, using 4 different classifiers. Also, dimensionality reduction was taken into account. Results indicate that the precision reduction improves classification accuracy for most cases (up to 25 bits gives the best scores and ensures that the results will not be worse than with the full floating-point representation.

READ FULL TEXT
research
01/26/2016

Vectorization of Multibyte Floating Point Data Formats

We propose a scheme for reduced-precision representation of floating poi...
research
07/17/2020

Training with reduced precision of a support vector machine model for text classification

This paper presents the impact of using quantization on the efficiency o...
research
06/28/2021

Reducing numerical precision preserves classification accuracy in Mondrian Forests

Mondrian Forests are a powerful data stream classification method, but t...
research
02/21/2018

Approximation Algorithms for Cascading Prediction Models

We present an approximation algorithm that takes a pool of pre-trained m...
research
08/07/2018

Rethinking Numerical Representations for Deep Neural Networks

With ever-increasing computational demand for deep learning, it is criti...
research
01/19/2019

Accumulation Bit-Width Scaling For Ultra-Low Precision Training Of Deep Networks

Efforts to reduce the numerical precision of computations in deep learni...
research
02/24/2020

Combining Learning and Optimization for Transprecision Computing

The growing demands of the worldwide IT infrastructure stress the need f...

Please sign up or login with your details

Forgot password? Click here to reset