GAETS: A Graph Autoencoder Time Series Approach Towards Battery Parameter Estimation

11/17/2021
by   Edward Elson Kosasih, et al.
21

Lithium-ion batteries are powering the ongoing transportation electrification revolution. Lithium-ion batteries possess higher energy density and favourable electrochemical properties which make it a preferable energy source for electric vehicles. Precise estimation of battery parameters (Charge capacity, voltage etc) is vital to estimate the available range in an electric vehicle. Graph-based estimation techniques enable us to understand the variable dependencies underpinning them to improve estimates. In this paper we employ Graph Neural Networks for battery parameter estimation, we introduce a unique graph autoencoder time series estimation approach. Variables in battery measurements are known to have an underlying relationship with each other in a certain correlation within variables of interest. We use graph autoencoder based on a non-linear version of NOTEARS as this allowed us to perform gradient-descent in learning the structure (instead of treating it as a combinatorial optimisation problem). The proposed architecture outperforms the state-of-the-art Graph Time Series (GTS) architecture for battery parameter estimation. We call our method GAETS (Graph AutoEncoder Time Series).

READ FULL TEXT VIEW PDF
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

11/19/2020

A Temporal Convolution Network Approach to State-of-Charge Estimation in Li-ion Batteries

Electric Vehicle (EV) fleets have dramatically expanded over the past se...
03/13/2021

Statistical inference for ARTFIMA time series with stable innovations

Autoregressive tempered fractionally integrated moving average with stab...
01/18/2021

Discrete Graph Structure Learning for Forecasting Multiple Time Series

Time series forecasting is an extensively studied subject in statistics,...
02/01/2022

Parameter estimation for the FOU(p) process with the same lambda

The FOU(p) processes can be considered as an alternative to ARMA (or ARF...
10/07/2021

To Charge or To Sell? EV Pack Useful Life Estimation via LSTMs and Autoencoders

Electric Vehicles (EVs) are spreading fast as they promise to provide be...
10/10/2018

Virtual Battery Parameter Identification using Transfer Learning based Stacked Autoencoder

Recent studies have shown that the aggregated dynamic flexibility of an ...
03/10/2021

Rapid parameter estimation of discrete decaying signals using autoencoder networks

In this work we demonstrate the use of autoencoder networks for rapid ex...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.

1 Introduction and Literature Review

Energy dense Lithium-ion batteries (LiB) are driving the current electrification revolution in the transportation sector Balasingam and Pattipati (2021). Rapid advancements in battery material science have enabled inexpensive and long-running LiBs. However, capacity degradation leading to poor performance are some of the drawbacks of these batteries Zhou et al. (2021). Development of accurate State-of-Charge estimation algorithms have garnered attention over the past decade as these metrics translate to available range in an Electric Vehicle Herle et al. (2020).

Battery degradation or capacity fade occurs due to repetitive charge/discharge cycles. Decreased battery capacity over its usage is an indicator of poor health of the battery Mohtat et al. (2021). Present battery models available in literature suffer from reliable battery capacity fade predictions Hinz (2019). This uncertainty in prediction is chiefly due to the non-linear behaviour of battery discharge characteristics with increased battery age.

Battery Ageing has also been a topic of considerable interest in the energy storage domain Ning and Popov (2004); Ning et al. (2006); Peterson et al. (2010); Barré et al. (2013). Empirical battery models have been used for Remaining Useful Life prediction of batteries Saha and Goebel (2009); Daigle and Kulkarni (2016); Nuhic et al. (2018); Andre et al. (2013)

. Simple estimators from Kalman Filter

Andre et al. (2013); Bole et al. (2014)

to Reinforcement Learning techniques

Unagar et al. (2020) have been employed for battery parameter estimation.

All the current battery parameter estimation techniques available in literature can be broadly classified as follows:

  1. Physics-based modeling which employs Partial Differential Equations (PDEs) to compute equivalent battery parameters

    Wang et al. (2011)

  2. Phenomenological battery modeling, achieved by focused computation of battery capacity changes corresponding to specific charge/discharge cycles Goebel et al. (2008)

  3. Data-driven estimation models, which provide meaningful insights from historical battery data and do not involve computation of complex electrochemical models Severson et al. (2019)

In the present work we use a Graph-based data-driven technique to gain meaningful insights from battery datasets to improve estimate accuracy. The paper is organised as follows, a brief review of graph based forecasting techniques is covered in Section 2, the architecture of the proposed Graph-based estimation technique is presented in Section 3, details about experimentation are covered in Section 4 followed by conclusion in Section 5.

2 Graph-based Time Series Estimation: Related Work

Battery datasets typically consist of time series Voltage, Current, Temperature and State-of-Charge values as shown in Fig. 1. Statistical Time series based estimation techniques have been popular Bhatnagar et al. (2021) for typical time series datasets.

Figure 1: Typical battery discharge characteristics of 18650 cells Herle et al. (2020)

In Multivariate time series scenarios variable dependencies have been investigated to improve estimations Yu et al. (2018). Traffic datasets are one of the prime examples wherein variation in speed and traffic density insights are useful to accurately predict vehicular traffic in other nodes of the network. There are numerous Graph Neural Network (GNN) based techniques which exploit the graph structure of datasets to improve prediction accuracy Seo et al. (2016), Li et al. (2018) and Zhao et al. (2020).

All Graph-based forecasting and estimation approaches available in literature have been validated using traffic datasets. A more recent variant of Graph Neural Network dubbed GTS (Graph for Time Series) has been successfully employed to learn specific graph structures to improve prediction accuracy Shang et al. (2021b). In this paper we build upon the GTS architecture specifically for battery datasets. Following section elucidates the proposed architecture in greater detail.

3 GAETS Architecture

3.1 The method

Figure 2: Graph AutoEncoder Time Series (GAETS) architecture

The architecture of GAETS is as depicted in 2. The objective of the method is to forecast , given the observations , where denotes training data and consists of multiple charge/discharge cycles of battery measurements. The model is denoted as , where is the graph structure and is parameterized by , is the input window duration, our goal is to predict future data from time to , here is the output prediction window length. The graph structure represented by adjacency matrix is to be parameterized as it is exclusively not available to the forecasting model. GTS Shang et al. (2021b) parameterizes the graph structure by considering the adjacency matrix

to be random variable on matrix Bernoulli distribution and is learned as part of the task. We use Gumbel reparameterization trick as it is used in

Shang et al. (2021b) because the gradients fail to flow through in Bernoulli sampling.

3.1.1 Encoder-Decoder

The encoder-decoder architecture is used in order to reconstruct the original time series data and to learn the intermediate represetations. The model assumes an inherent nonlinear Structural Equation Model (SEM) that connects the node features to the adjacency matrix. The SEM was first proposed in NOTEARS Zheng et al. (2018).

(1)

where and are neural networks, encoder and decoder respectively while represents the node id. This can be seen as a graph autoencoder. The encoder extracts the features from the original time series data, by applying a fully connected layer on the convolved original features.

where

is the features extracted in the lower dimensional space.

is the th series of features. The matrix of representations

s generated by the encoders are used in the graph autoencoder as well as in the link predictor. In this scenario the vector representations are fed as input to the link predictor which spits out a scalar. The output scalar decides the existance of a link. These are represented as

and , the vectors are concatenated and passed through two fully connected layers to finally get the scalar.

The extracted features along with the sampled graph adjacency matrix is passed through the decoder. We make use of an MLP as the decoder. The loss incurred by the autoencoder also adds up to the final loss to be optimized.

3.1.2 Recurrent Networks

In order to estimate the time series predictions based on graphs, we make use of diffusion convolutional GRU as in DCRNN Li et al. (2018) and GTS Shang et al. (2021b).

where

where all s are corresponding weight matrices, and are in-degree and out-degree matrix respectively. and and are the model parameters and

is the hyperparameter corresponding to the degree of diffusion.

3.2 Training

The time series forecasting loss is the base loss which is the loss between the values forecasted by the models and the ground truth. Hence the first objective is given in 2.

(2)

The autoencoder compares the reconstructed data against the input data. The autoencoder loss, the second objective is given in 3.

(3)

where, is the number of samples, and acts as a regularizer to the original GTS (Shang et al. (2021a)) loss. The original GTS loss is given in 2.

The final loss comprises of the loss incurred by the autoencoder and the base loss. It is given in 4.

(4)

Finally, we arrive at the expression 5 that we need to minimize.

(5)

4 Experiments

To validate the GAETS architecture we used Lithium-ion Battery Data (2018). All the batteries listed in the dataset had multiple charge/discharge cycles. We trained the model on two sets of measurement values logged from two separate channels. The data consists of 6 measurements namely: Voltage, Current, Charge Capacity, Discharge Capacity, Charge Energy and Discharge Energy. Each measurement is treated as a node and the task is to learn the structure that represents relationship between variables as well as forecasting the battery parameter of interest. We fix the input horizon to be 80 and test the data on three different forecasting window horizons of 40, 80 and 120.

In terms of tensor size, the training data is made of (

, ) where is 1497 signals with a dimension of 6 (for each measurement) and horizon as 80, while is 1497 signals with a dimension of 6 and 40/80/120 horizon values. Validation is done on 213 signals. Meanwhile, testing data is made of (, ) where is 1497 signals with a dimension of 6 (for each measurement) and 80 window ticks, while is 1497 signals with a dimension of 6 and 40/80/120 horizon values. These datasets are obtained by continuous moving window average across the original long time series data.

We follow the code implementation in GTS Shang et al. (2021a)

, using the same setting for the graph neural network architecture and optimiser. We train each model for 200 epochs, obtain the best model for validation dataset and test it. Each model is trained from 5 different random initialisations. The performance result and confidence interval is shown in the chart. Performance is measured through MAE, RMSE and MAPE values as shown in Fig. 6 following GTS

Shang et al. (2021a) paper. Visual comparison of Battery Voltage, Current and Charge Energy is presented in Fig. 3,4 and 5.

(a)
(b)
Figure 3: Battery Voltage predictions using GAETS (this work) and GTS Shang et al. (2021a)
(a)
(b)
Figure 4: Battery Current predictions using GAETS (this work) and GTS Shang et al. (2021a)
(a)
(b)
Figure 5: Battery Energy predictions using GAETS (this work) and GTS Shang et al. (2021a)
(a) MAE
(b) MAPE
(c) RMSE
Figure 6: Evaluation metrics comparing the proposed GAETS architecture with GTS

5 Conclusion

Battery parameter estimation remains to be a challenging and topic of relevance due to the burgeoning number of Electric Vehicles in the past decade. Accurate battery capacity estimation also helps to predict remaining usage time in battery powered consumer electronics. In this paper we introduce a Graph AutoEncoder Time Series (GAETS) architecture which exploits the dependencies between battery parameters (charge capacity, voltage, current etc) to provide precise estimates. We compare our architecture with the existing Graph Time Series architecture to highlight the effectiveness of our approach.

References

  • D. Andre, A. Nuhic, T. Soczka-Guth, and D. U. Sauer (2013) Comparative study of a structured neural network and an extended kalman filter for state of health determination of lithium-ion batteries in hybrid electricvehicles.

    Engineering Applications of Artificial Intelligence

    26 (3), pp. 951–961.
    Cited by: §1.
  • B. Balasingam and K. Pattipati (2021) On the identification of electrical equivalent circuit models based on noisy measurements. External Links: 2101.05349 Cited by: §1.
  • A. Barré, B. Deguilhem, S. Grolleau, M. Gérard, F. Suard, and D. Riu (2013) A review on lithium-ion battery ageing mechanisms and estimations for automotive applications. Journal of Power Sources 241, pp. 680–689. Cited by: §1.
  • A. Bhatnagar, P. Kassianik, C. Liu, T. Lan, W. Yang, R. Cassius, D. Sahoo, D. Arpit, S. Subramanian, G. Woo, A. Saha, A. K. Jagota, G. Gopalakrishnan, M. Singh, K. C. Krithika, S. Maddineni, D. Cho, B. Zong, Y. Zhou, C. Xiong, S. Savarese, S. Hoi, and H. Wang (2021)

    Merlion: a machine learning library for time series

    .
    External Links: 2109.09265 Cited by: §2.
  • B. Bole, C. S. Kulkarni, and M. Daigle (2014) Adaptation of an electrochemistry-based li-ion battery model to account for deterioration observed under randomized use. Technical report SGT, Inc. Moffett Field United States. Cited by: §1.
  • M. Daigle and C. S. Kulkarni (2016) End-of-discharge and end-of-life prediction in lithium-ion batteries with electrochemistry-based aging models. In AIAA Infotech@ Aerospace, pp. 2132. Cited by: §1.
  • B. Data (2018) Center for Advanced Life Cycle Engineering. Note: https://calce.umd.edu/battery-data/[Online; Accessed 19-July-2021] Cited by: §4.
  • K. Goebel, B. Saha, A. Saxena, J. R. Celaya, and J. P. Christophersen (2008) Prognostics in battery health management. IEEE instrumentation & measurement magazine 11 (4), pp. 33–40. Cited by: item 2.
  • A. Herle, J. Channegowda, and D. Prabhu (2020) A temporal convolution network approach to state-of-charge estimation in li-ion batteries. External Links: 2011.09775 Cited by: §1, Figure 1.
  • H. Hinz (2019) Comparison of lithium-ion battery models for simulating storage systems in distributed power generation. Inventions 41 (4). Cited by: §1.
  • Y. Li, R. Yu, C. Shahabi, and Y. Liu (2018)

    Diffusion convolutional recurrent neural network: data-driven traffic forecasting

    .
    External Links: 1707.01926 Cited by: §2, §3.1.2.
  • P. Mohtat, S. Pannala, V. Sulzer, J. B. Siegel, and A. G. Stefanopoulou (2021) An algorithmic safety vest for li-ion batteries during fast charging. External Links: 2108.07833 Cited by: §1.
  • G. Ning and B. N. Popov (2004) Cycle life modeling of lithium-ion batteries. Journal of The Electrochemical Society 151 (10), pp. A1584. Cited by: §1.
  • G. Ning, R. E. White, and B. N. Popov (2006) A generalized cycle life model of rechargeable li-ion batteries. Electrochimica acta 51 (10), pp. 2012–2022. Cited by: §1.
  • A. Nuhic, J. Bergdolt, B. Spier, M. Buchholz, and K. Dietmayer (2018) Battery health monitoring and degradation prognosis in fleet management systems. World Electric Vehicle Journal 9 (3), pp. 39. Cited by: §1.
  • S. B. Peterson, J. Apt, and J. Whitacre (2010) Lithium-ion battery cell degradation resulting from realistic vehicle and vehicle-to-grid utilization. Journal of Power Sources 195 (8), pp. 2385–2392. Cited by: §1.
  • B. Saha and K. Goebel (2009) Modeling li-ion battery capacity depletion in a particle filtering framework. In Proceedings of the annual conference of the prognostics and health management society, pp. 2909–2924. Cited by: §1.
  • Y. Seo, M. Defferrard, P. Vandergheynst, and X. Bresson (2016) Structured sequence modeling with graph convolutional recurrent networks. External Links: 1612.07659 Cited by: §2.
  • K. A. Severson, P. M. Attia, N. Jin, N. Perkins, B. Jiang, Z. Yang, M. H. Chen, M. Aykol, P. K. Herring, D. Fraggedakis, et al. (2019) Data-driven prediction of battery cycle life before capacity degradation. Nature Energy 4 (5), pp. 383–391. Cited by: item 3.
  • C. Shang, J. Chen, and J. Bi (2021a) Discrete graph structure learning for forecasting multiple time series. CoRR abs/2101.06861. External Links: Link, 2101.06861 Cited by: GAETS: A Graph Autoencoder Time Series Approach Towards Battery Parameter Estimation, §3.2, Figure 3, Figure 4, Figure 5, §4.
  • C. Shang, J. Chen, and J. Bi (2021b) Discrete graph structure learning for forecasting multiple time series. External Links: 2101.06861 Cited by: §2, §3.1.2, §3.1.
  • A. Unagar, Y. Tian, M. Arias-Chao, and O. Fink (2020) Battery model calibration with deep reinforcement learning. External Links: 2012.04010 Cited by: §1.
  • J. Wang, P. Liu, J. Hicks-Garner, E. Sherman, S. Soukiazian, M. Verbrugge, H. Tataria, J. Musser, and P. Finamore (2011) Cycle-life model for graphite-lifepo4 cells. Journal of power sources 196 (8), pp. 3942–3948. Cited by: item 1.
  • B. Yu, H. Yin, and Z. Zhu (2018)

    Spatio-temporal graph convolutional networks: a deep learning framework for traffic forecasting

    .
    Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence. External Links: ISBN 9780999241127, Link, Document Cited by: §2.
  • L. Zhao, Y. Song, C. Zhang, Y. Liu, P. Wang, T. Lin, M. Deng, and H. Li (2020) T-gcn: a temporal graph convolutional network for traffic prediction. IEEE Transactions on Intelligent Transportation Systems 21 (9), pp. 3848–3858. External Links: ISSN 1558-0016, Link, Document Cited by: §2.
  • X. Zheng, B. Aragam, P. Ravikumar, and E. P. Xing (2018) DAGs with no tears: continuous optimization for structure learning. External Links: 1803.01422 Cited by: GAETS: A Graph Autoencoder Time Series Approach Towards Battery Parameter Estimation, §3.1.1.
  • K. Q. Zhou, Y. Qin, B. P. L. Lau, C. Yuen, and S. Adams (2021) Lithium-ion battery state of health estimation based on cycle synchronization using dynamic time warping. External Links: 2109.13448 Cited by: §1.