A Linter for Isabelle: Implementation and Evaluation

07/21/2022
by   Yecine Megdiche, et al.
0

In interactive theorem proving, formalization quality is a key factor for maintainability and re-usability of developments and can also impact proof-checking performance. Commonly, anti-patterns that cause quality issues are known to experienced users. However, in many theorem prover systems, there are no automatic tools to check for their presence and make less experienced users aware of them. We attempt to fill this gap in the Isabelle environment by developing a linter as a publicly available add-on component. The linter offers basic configurability, extensibility, Isabelle/jEdit integration, and a standalone command-line tool. We uncovered 480 potential problems in Isabelle/HOL, 14016 in other formalizations of the Isabelle distribution, and an astonishing 59573 in the AFP. With a specific lint bundle for AFP submissions, we found that submission guidelines were violated in 1595 cases. We set out to alleviate problems in Isabelle/HOL and solved 168 of them so far; we found that high-severity lints corresponded to actual problems most of the time, individual users often made the same mistakes in many places, and that solving those problems retrospectively amounts to a substantial amount of work. In contrast, solving these problems interactively for new developments usually incurs only little overhead, as we found in a quantitative user survey with 22 participants (less than a minute for more than 60 found that a good explanation of problems is key to the users' ease of solving these problems (correlation coefficient 0.48), and their satisfaction with the end result (correlation coefficient 0.62).

READ FULL TEXT
research
11/09/2022

A survey of some recent developments in measures of association

This paper surveys some recent developments in measures of association r...
research
01/04/2021

Lassie: HOL4 Tactics by Example

Proof engineering efforts using interactive theorem proving have yielded...
research
08/29/2018

Accessibility or Usability of InteractSE? A Heuristic Based Approach to Evaluate Proposed Search Engine for the Visually Impaired Users

Internet is the main source of information nowadays. The search engines ...
research
06/29/2019

Domain-Specific Language to Encode Induction Heuristics

Proof assistants, such as Isabelle/HOL, offer tools to facilitate induct...
research
06/19/2019

LiFtEr: Language to Encode Induction Heuristics for Isabelle/HOL

Proof assistants, such as Isabelle/HOL, offer tools to facilitate induct...
research
02/01/2023

Anti-unification and Generalization: A Survey

Anti-unification (AU), also known as generalization, is a fundamental op...
research
07/04/2021

Proceedings Seventh Workshop on Proof eXchange for Theorem Proving

This volume of EPTCS contains the proceedings of the Seventh Workshop on...

Please sign up or login with your details

Forgot password? Click here to reset