Live Recovery of Bit Corruptions in Datacenter Storage Systems

05/08/2018
by   Amy Tai, et al.
0

Due to its high performance and decreasing cost per bit, flash is becoming the main storage medium in datacenters for hot data. However, flash endurance is a perpetual problem, and due to technology trends, subsequent generations of flash devices exhibit progressively shorter lifetimes before they experience uncorrectable bit errors. In this paper we propose extending flash lifetime by allowing devices to expose higher bit error rates. To do so, we present DIRECT, a novel set of policies that leverages latent redundancy in distributed storage systems to recover from bit corruption errors with minimal performance and recovery overhead. In doing so, DIRECT can significantly extend the lifetime of flash devices by effectively utilizing these devices even after they begin exposing bit errors. We implemented DIRECT on two real-world storage systems: ZippyDB, a distributed key-value store backed by RocksDB, and HDFS, a distributed file system. When tested on production traces at Facebook, DIRECT reduces application-visible error rates in ZippyDB by more than 10^2 and recovery time by more than 10^4. DIRECT also allows HDFS to tolerate a 10^4--10^5 higher bit error rate without experiencing application-visible errors.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/25/2019

A Survey on Tiering and Caching in High-Performance Storage Systems

Although every individual invented storage technology made a big step to...
research
12/20/2013

Support for Error Tolerance in the Real-Time Transport Protocol

Streaming applications often tolerate bit errors in their received data ...
research
03/26/2018

Reactive NaN Repair for Applying Approximate Memory to Numerical Applications

Applications in the AI and HPC fields require much memory capacity, and ...
research
08/26/2019

Tvarak: Software-managed hardware offload for DAX NVM storage redundancy

Tvarak efficiently implements system-level redundancy for direct-access ...
research
04/20/2020

Vilamb: Low Overhead Asynchronous Redundancy for Direct Access NVM

Vilamb provides efficient asynchronous systemredundancy for direct acces...
research
02/03/2020

Towards Explainable Bit Error Tolerance of Resistive RAM-Based Binarized Neural Networks

Non-volatile memory, such as resistive RAM (RRAM), is an emerging energy...
research
10/09/2020

C for a tiny system

We have implemented support for Padauk microcontrollers, tiny 8-Bit devi...

Please sign up or login with your details

Forgot password? Click here to reset