Interactive Log Parsing via Light-weight User Feedbacks

01/28/2023
by   Liming Wang, et al.
0

Template mining is one of the foundational tasks to support log analysis, which supports the diagnosis and troubleshooting of large scale Web applications. This paper develops a human-in-the-loop template mining framework to support interactive log analysis, which is highly desirable in real-world diagnosis or troubleshooting of Web applications but yet previous template mining algorithms fails to support it. We formulate three types of light-weight user feedbacks and based on them we design three atomic human-in-the-loop template mining algorithms. We derive mild conditions under which the outputs of our proposed algorithms are provably correct. We also derive upper bounds on the computational complexity and query complexity of each algorithm. We demonstrate the versatility of our proposed algorithms by combining them to improve the template mining accuracy of five representative algorithms over sixteen widely used benchmark datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/13/2019

RDD-Eclat: Approaches to Parallelize Eclat Algorithm on Spark RDD Framework

Initially, a number of frequent itemset mining (FIM) algorithms have bee...
research
04/11/2011

Template-based matching using weight maps

Template matching is one of the most prevalent pattern recognition metho...
research
10/22/2021

RDD-Eclat: Approaches to Parallelize Eclat Algorithm on Spark RDD Framework (Extended Version)

Frequent itemset mining (FIM) is a highly computational and data intensi...
research
08/29/2016

Using k-nearest neighbors to construct cancelable minutiae templates

Fingerprint is widely used in a variety of applications. Security measur...
research
07/19/2023

Prompting for Automatic Log Template Extraction

Log parsing, the initial and vital stage in automated log analysis, invo...
research
02/11/2019

A Minimal Template for Interactive Web-based Demonstrations of Musical Machine Learning

New machine learning algorithms are being developed to solve problems in...
research
07/31/2023

Alpha-GPT: Human-AI Interactive Alpha Mining for Quantitative Investment

One of the most important tasks in quantitative investment research is m...

Please sign up or login with your details

Forgot password? Click here to reset