A new rotating machinery fault diagnosis method based on the Time Series Transformer

08/28/2021
by   Yuhong Jin, et al.
0

Fault diagnosis of rotating machinery is an important engineering problem. In recent years, fault diagnosis methods based on the Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN) have been mature, but Transformer has not been widely used in the field of fault diagnosis. To address these deficiencies, a new method based on the Time Series Transformer (TST) is proposed to recognize the fault mode of bearings. In this paper, our contributions include: Firstly, we designed a tokens sequences generation method which can handle data in 1D format, namely time series tokenizer. Then, the TST combining time series tokenizer and Transformer was introduced. Furthermore, the test results on the given dataset show that the proposed method has better fault identification capability than the traditional CNN and RNN models. Secondly, through the experiments, the effect of structural hyperparameters such as subsequence length and embedding dimension on fault diagnosis performance, computational complexity and parameters number of the TST is analyzed in detail. The influence laws of some hyperparameters are obtained. Finally, via t-Distributed Stochastic Neighbor Embedding (t-SNE) dimensionality reduction method, the feature vectors in the embedding space are visualized. On this basis, the working pattern of TST has been explained to a certain extent. Moreover, by analyzing the distribution form of the feature vectors, we find that compared with the traditional CNN and RNN models, the feature vectors extracted by the method in this paper show the best intra-class compactness and inter-class separability. These results further demonstrate the effectiveness of the proposed method.

READ FULL TEXT
research
12/03/2021

A Novel Deep Parallel Time-series Relation Network for Fault Diagnosis

Considering the models that apply the contextual information of time-ser...
research
11/16/2021

Graph neural network-based fault diagnosis: a review

Graph neural network (GNN)-based fault diagnosis (FD) has received incre...
research
04/14/2023

Real Time Bearing Fault Diagnosis Based on Convolutional Neural Network and STM32 Microcontroller

With the rapid development of big data and edge computing, many research...
research
10/21/2021

Power Transformer Fault Diagnosis with Intrinsic Time-scale Decomposition and XGBoost Classifier

An intrinsic time-scale decomposition (ITD) based method for power trans...
research
08/18/2021

Transformers predicting the future. Applying attention in next-frame and time series forecasting

Recurrent Neural Networks were, until recently, one of the best ways to ...
research
11/01/2022

Fault diagnosis for three-phase PWM rectifier based on deep feedforward network with transient synthetic features

Three-phase PWM rectifiers are adopted extensively in industry because o...
research
04/11/2023

Multi-scale Fusion Fault Diagnosis Method Based on Two-Dimensionaliztion Sequence in Complex Scenarios

Rolling bearings are critical components in rotating machinery, and thei...

Please sign up or login with your details

Forgot password? Click here to reset