Are Query-Based Ontology Debuggers Really Helping Knowledge Engineers?

by   Patrick Rodler, et al.

Real-world semantic or knowledge-based systems, e.g., in the biomedical domain, can become large and complex. Tool support for the localization and repair of faults within knowledge bases of such systems can therefore be essential for their practical success. Correspondingly, a number of knowledge base debugging approaches, in particular for ontology-based systems, were proposed throughout recent years. Query-based debugging is a comparably recent interactive approach that localizes the true cause of an observed problem by asking knowledge engineers a series of questions. Concrete implementations of this approach exist, such as the OntoDebug plug-in for the ontology editor Protégé. To validate that a newly proposed method is favorable over an existing one, researchers often rely on simulation-based comparisons. Such an evaluation approach however has certain limitations and often cannot fully inform us about a method's true usefulness. We therefore conducted different user studies to assess the practical value of query-based ontology debugging. One main insight from the studies is that the considered interactive approach is indeed more efficient than an alternative algorithmic debugging based on test cases. We also observed that users frequently made errors in the process, which highlights the importance of a careful design of the queries that users need to answer.



There are no comments yet.



Interactive ontology debugging: two query strategies for efficient fault localization

Effective debugging of ontologies is an important prerequisite for their...

Query strategy for sequential ontology debugging

Debugging of ontologies is an important prerequisite for their wide-spre...

Ontology-based Queries over Cancer Data

The ever-increasing amount of data in biomedical research, and in cancer...

A Theory of Interactive Debugging of Knowledge Bases in Monotonic Logics

A broad variety of knowledge-based applications such as recommender, exp...

BigCQ: A large-scale synthetic dataset of competency question patterns formalized into SPARQL-OWL query templates

Competency Questions (CQs) are used in many ontology engineering methodo...

A New Expert Questioning Approach to More Efficient Fault Localization in Ontologies

When ontologies reach a certain size and complexity, faults such as inco...

Towards Better Response Times and Higher-Quality Queries in Interactive Knowledge Base Debugging

Many AI applications rely on knowledge encoded in a locigal knowledge ba...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.