Representation-Oblivious Error Correction by Natural Redundancy

11/09/2018
by   Pulakesh Upadhyaya, et al.
0

Storage systems have a strong need for substantially improving their error correction capabilities, especially for long-term storage where the accumulating errors can exceed the decoding threshold of error-correcting codes (ECCs). In this work, a new scheme is presented that uses deep learning to perform soft decoding for noisy files based on their natural redundancy. The soft decoding result is then combined with ECCs for substantially better error correction performance. The scheme is representation-oblivious: it requires no prior knowledge on how data are represented (e.g., mapped from symbols to bits, compressed, and combined with meta data) in different types of files, which makes the solution more convenient to use for storage systems. Experimental results confirm that the scheme can substantially improve the ability to recover data for different types of files even when the bit error rates in the files have significantly exceeded the decoding threshold of the ECC.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/15/2019

Machine Learning for Error Correction with Natural Redundancy

The persistent storage of big data requires advanced error correction sc...
research
01/12/2020

Functional Error Correction for Robust Neural Networks

When neural networks (NeuralNets) are implemented in hardware, their wei...
research
04/07/2023

Iterative Soft Decoding Algorithm for DNA Storage Using Quality Score and Redecoding

Ever since deoxyribonucleic acid (DNA) was considered as a next-generati...
research
06/28/2023

Exploration and Analysis of Combinations of Hamming Codes in 32-bit Memories

Reducing the threshold voltage of electronic devices increases their sen...
research
03/03/2020

Enhancing simultaneous rational function recovery: adaptive error correction capability and new bounds for applications

In this work we present some results that allow to improve the decoding ...
research
07/01/2019

On list decoding of 5G-NR polar codes

The 5G standardization process of the 3GPP included polar codes concaten...
research
03/27/2022

Error Correction Code Transformer

Error correction code is a major part of the communication physical laye...

Please sign up or login with your details

Forgot password? Click here to reset