StaTIX - Statistical Type Inference on Linked Data

02/01/2019
by   Artem Lutov, et al.
0

Large knowledge bases typically contain data adhering to various schemas with incomplete and/or noisy type information. This seriously complicates further integration and post-processing efforts, as type information is crucial in correctly handling the data. In this paper, we introduce a novel statistical type inference method, called StaTIX, to effectively infer instance types in Linked Data sets in a fully unsupervised manner. Our inference technique leverages a new hierarchical clustering algorithm that is robust, highly effective, and scalable. We introduce a novel approach to reduce the processing complexity of the similarity matrix specifying the relations between various instances in the knowledge base. This approach speeds up the inference process while also improving the correctness of the inferred types due to the noise attenuation in the input data. We further optimize the clustering process by introducing a dedicated hash function that speeds up the inference process by orders of magnitude without negatively affecting its accuracy. Finally, we describe a new technique to identify representative clusters from the multi-scale output of our clustering algorithm to further improve the accuracy of the inferred types. We empirically evaluate our approach on several real-world datasets and compare it to the state of the art. Our results show that StaTIX is more efficient than existing methods (both in terms of speed and memory consumption) as well as more effective. StaTIX reduces the F1-score error of the predicted types by about 40 the art and improves the execution time by orders of magnitude.

READ FULL TEXT

page 1

page 8

research
09/19/2019

DAOC: Stable Clustering of Large Networks

Clustering is a crucial component of many data mining systems involving ...
research
08/14/2021

Data Type Inference for Logic Programming

In this paper we present a new static data type inference algorithm for ...
research
11/13/2014

Handling owl:sameAs via Rewriting

Rewriting is widely used to optimise owl:sameAs reasoning in materialisa...
research
05/08/2021

HiTyper: A Hybrid Static Type Inference Framework with Neural Prediction

Type inference for dynamic programming languages is an important yet cha...
research
10/10/2019

Detecting organized eCommerce fraud using scalable categorical clustering

Online retail, eCommerce, frequently falls victim to fraud conducted by ...
research
08/01/2011

Scaling Inference for Markov Logic with a Task-Decomposition Approach

Motivated by applications in large-scale knowledge base construction, we...

Please sign up or login with your details

Forgot password? Click here to reset