WebRobot: Web Robotic Process Automation using Interactive Programming-by-Demonstration

03/18/2022
by   Rui Dong, et al.
0

It is imperative to democratize robotic process automation (RPA), as RPA has become a main driver of the digital transformation but is still technically very demanding to construct, especially for non-experts. In this paper, we study how to automate an important class of RPA tasks, dubbed web RPA, which are concerned with constructing software bots that automate interactions across data and a web browser. Our main contributions are twofold. First, we develop a formal foundation which allows semantically reasoning about web RPA programs and formulate its synthesis problem in a principled manner. Second, we propose a web RPA program synthesis algorithm based on a new idea called speculative rewriting. This leads to a novel speculate-and-validate methodology in the context of rewrite-based program synthesis, which has also shown to be both theoretically simple and practically efficient for synthesizing programs from demonstrations. We have built these ideas in a new interactive synthesizer called WebRobot and evaluate it on 76 web RPA benchmarks. Our results show that WebRobot automated a majority of them effectively. Furthermore, we show that WebRobot compares favorably with a conventional rewrite-based synthesis baseline implemented using egg. Finally, we conduct a small user study demonstrating WebRobot is also usable.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/10/2023

DiLogics: Creating Web Automation Programs With Diverse Logics

Knowledge workers frequently encounter repetitive web data entry tasks, ...
research
05/04/2023

Program Synthesis for Robot Learning from Demonstrations

This paper presents a new synthesis-based approach for solving the Learn...
research
09/24/2019

Using human-in-the-loop synthesis to author functional reactive programs

Programs that respond to asynchronous events are challenging to write; t...
research
05/25/2017

Data-Driven Program Completion

We introduce program splicing, a programming methodology that aims to au...
research
08/24/2020

Multi-Modal End-User Programming of Web-Based Virtual Assistant Skills

While Alexa can perform over 100,000 skills on paper, its capability cov...
research
07/05/2017

Synthesis of Data Completion Scripts using Finite Tree Automata

In application domains that store data in a tabular format, a common tas...
research
01/08/2020

On the Evaluation of Intelligent Process Automation

Intelligent Process Automation (IPA) is emerging as a sub-field of AI to...

Please sign up or login with your details

Forgot password? Click here to reset