First CE Matters: On the Importance of Long Term Properties on Memory Failure Prediction

by   Jasmin Bogatinovski, et al.

Dynamic random access memory failures are a threat to the reliability of data centres as they lead to data loss and system crashes. Timely predictions of memory failures allow for taking preventive measures such as server migration and memory replacement. Thereby, memory failure prediction prevents failures from externalizing, and it is a vital task to improve system reliability. In this paper, we revisited the problem of memory failure prediction. We analyzed the correctable errors (CEs) from hardware logs as indicators for a degraded memory state. As memories do not always work with full occupancy, access to faulty memory parts is time distributed. Following this intuition, we observed that important properties for memory failure prediction are distributed through long time intervals. In contrast, related studies, to fit practical constraints, frequently only analyze the CEs from the last fixed-size time interval while ignoring the predating information. Motivated by the observed discrepancy, we study the impact of including the overall (long-range) CE evolution and propose novel features that are calculated incrementally to preserve long-range properties. By coupling the extracted features with machine learning methods, we learn a predictive model to anticipate upcoming failures three hours in advance while improving the average relative precision and recall for 21 memory failures from the server fleet of a large cloud provider, justifying its validity and practicality.


Highly Efficient Memory Failure Prediction using Mcelog-based Data Mining and Machine Learning

In the data center, unexpected downtime caused by memory failures can le...

DC-Prophet: Predicting Catastrophic Machine Failures in DataCenters

When will a server fail catastrophically in an industrial datacenter? Is...

Diffusion-based Time Series Data Imputation for Microsoft 365

Reliability is extremely important for large-scale cloud systems like Mi...

Cloud Failure Prediction with Hierarchical Temporal Memory: An Empirical Assessment

Hierarchical Temporal Memory (HTM) is an unsupervised learning algorithm...

NDBench: Benchmarking Microservices at Scale

Software vendors often report performance numbers for the sweet spot or ...

Prediction of Future Failures for Heterogeneous Reliability Field Data

This article introduces methods for constructing prediction bounds or in...

Long-Term Pipeline Failure Prediction Using Nonparametric Survival Analysis

Australian water infrastructure is more than a hundred years old, thus h...

Please sign up or login with your details

Forgot password? Click here to reset