LogStamp: Automatic Online Log Parsing Based on Sequence Labelling

08/10/2022
by   Shimin Tao, et al.
0

Logs are one of the most critical data for service management. It contains rich runtime information for both services and users. Since size of logs are often enormous in size and have free handwritten constructions, a typical log-based analysis needs to parse logs into structured format first. However, we observe that most existing log parsing methods cannot parse logs online, which is essential for online services. In this paper, we present an automatic online log parsing method, name as LogStamp. We extensively evaluate LogStamp on five public datasets to demonstrate the effectiveness of our proposed method. The experiments show that our proposed method can achieve high accuracy with only a small portion of the training set. For example, it can achieve an average accuracy of 0.956 when using only 10

READ FULL TEXT
research
01/07/2020

Logram: Efficient Log Parsing Using n-Gram Dictionaries

Software systems usually record important runtime information in their l...
research
04/24/2023

USTEP: Structuration des logs en flux grâce à un arbre de recherche évolutif

Logs record valuable system information at runtime. They are widely used...
research
09/14/2021

GPT-2C: A GPT-2 parser for Cowrie honeypot logs

Deception technologies like honeypots produce comprehensive log reports,...
research
09/19/2017

Automatic Structural Scene Digitalization

In this paper, we present an automatic system for the analysis and label...
research
06/12/2018

A Directed Acyclic Graph Approach to Online Log Parsing

Logs are widely used in modern software system management because they a...
research
12/29/2022

System Log Parsing: A Survey

Modern information and communication systems have become increasingly ch...
research
12/16/2020

Summarizing Unstructured Logs in Online Services

Logs are one of the most valuable data sources for managing large-scale ...

Please sign up or login with your details

Forgot password? Click here to reset