Using Semantic Similarity for Input Topic Identification in Crawling-based Web Application Testing

by   Jun-Wei Lin, et al.

To automatically test web applications, crawling-based techniques are usually adopted to mine the behavior models, explore the state spaces or detect the violated invariants of the applications. However, in existing crawlers, rules for identifying the topics of input text fields, such as login ids, passwords, emails, dates and phone numbers, have to be manually configured. Moreover, the rules for one application are very often not suitable for another. In addition, when several rules conflict and match an input text field to more than one topics, it can be difficult to determine which rule suggests a better match. This paper presents a natural-language approach to automatically identify the topics of encountered input fields during crawling by semantically comparing their similarities with the input fields in labeled corpus. In our evaluation with 100 real-world forms, the proposed approach demonstrated comparable performance to the rule-based one. Our experiments also show that the accuracy of the rule-based approach can be improved by up to 19 our approach.



There are no comments yet.


page 1

page 2

page 3

page 4


A Rule-based Kurdish Text Transliteration System

In this article, we present a rule-based approach for transliterating tw...

Rule-Based Semantic Sensing

Rule-Based Systems have been in use for decades to solve a variety of pr...

A Rule-Based Short Query Intent Identification System

Using SMS (Short Message System), cell phones can be used to query for i...

Automatic Meter Classification of Kurdish Poems

Most of the classic texts in Kurdish literature are poems. Knowing the m...

Learning Symbolic Rules for Reasoning in Quasi-Natural Language

Symbolic reasoning, rule-based symbol manipulation, is a hallmark of hum...

NeuTral Rewriter: A Rule-Based and Neural Approach to Automatic Rewriting into Gender-Neutral Alternatives

Recent years have seen an increasing need for gender-neutral and inclusi...

Machine learning-assisted virtual patching of web applications

Web applications are permanently being exposed to attacks that exploit t...

Code Repositories

This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.