Towards Better Response Times and Higher-Quality Queries in Interactive Knowledge Base Debugging

by   Patrick Rodler, et al.

Many AI applications rely on knowledge encoded in a locigal knowledge base (KB). The most essential benefit of such logical KBs is the opportunity to perform automatic reasoning which however requires a KB to meet some minimal quality criteria such as consistency. Without adequate tool assistance, the task of resolving such violated quality criteria in a KB can be extremely hard, especially when the problematic KB is large and complex. To this end, interactive KB debuggers have been introduced which ask a user queries whether certain statements must or must not hold in the intended domain. The given answers help to gradually restrict the search space for KB repairs. Existing interactive debuggers often rely on a pool-based strategy for query computation. A pool of query candidates is precomputed, from which the best candidate according to some query quality criterion is selected to be shown to the user. This often leads to the generation of many unnecessary query candidates and thus to a high number of expensive calls to logical reasoning services. We tackle this issue by an in-depth mathematical analysis of diverse real-valued active learning query selection measures in order to determine qualitative criteria that make a query favorable. These criteria are the key to devising efficient heuristic query search methods. The proposed methods enable for the first time a completely reasoner-free query generation for interactive KB debugging while at the same time guaranteeing optimality conditions, e.g. minimal cardinality or best understandability for the user, of the generated query that existing methods cannot realize. Further, we study different relations between active learning measures. The obtained picture gives a hint about which measures are more favorable in which situation or which measures always lead to the same outcomes, based on given types of queries.



There are no comments yet.


page 1

page 2

page 3

page 4


Scalable Computation of Optimized Queries for Sequential Diagnosis

In many model-based diagnosis applications it is impossible to provide s...

A Theory of Interactive Debugging of Knowledge Bases in Monotonic Logics

A broad variety of knowledge-based applications such as recommender, exp...

Pool-based sequential active learning with multi kernels

We study a pool-based sequential active learning (AL), in which one samp...

Query Understanding via Entity Attribute Identification

Understanding searchers' queries is an essential component of semantic s...

Structural query-by-committee

In this work, we describe a framework that unifies many different intera...

Are Query-Based Ontology Debuggers Really Helping Knowledge Engineers?

Real-world semantic or knowledge-based systems, e.g., in the biomedical ...

Toward Machine-Guided, Human-Initiated Explanatory Interactive Learning

Recent work has demonstrated the promise of combining local explanations...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.