Scaling Inference for Markov Logic with a Task-Decomposition Approach

08/01/2011
by   Feng Niu, et al.
0

Motivated by applications in large-scale knowledge base construction, we study the problem of scaling up a sophisticated statistical inference framework called Markov Logic Networks (MLNs). Our approach, Felix, uses the idea of Lagrangian relaxation from mathematical programming to decompose a program into smaller tasks while preserving the joint-inference property of the original MLN. The advantage is that we can use highly scalable specialized algorithms for common tasks such as classification and coreference. We propose an architecture to support Lagrangian relaxation in an RDBMS which we show enables scalable joint inference for MLNs. We empirically validate that Felix is significantly more scalable and efficient than prior approaches to MLN inference by constructing a knowledge base from 1.8M documents as part of the TAC challenge. We show that Felix scales and achieves state-of-the-art quality numbers. In contrast, prior approaches do not scale even to a subset of the corpus that is three orders of magnitude smaller.

READ FULL TEXT
research
02/27/2017

Differentiable Learning of Logical Rules for Knowledge Base Reasoning

We study the problem of learning probabilistic first-order logical rules...
research
02/14/2020

Scalable Neural Methods for Reasoning With a Symbolic Knowledge Base

We describe a novel way of representing a symbolic knowledge base (KB) c...
research
03/06/2013

Using First-Order Probability Logic for the Construction of Bayesian Networks

We present a mechanism for constructing graphical models, specifically B...
research
02/03/2015

Incremental Knowledge Base Construction Using DeepDive

Populating a database with unstructured information is a long-standing p...
research
11/15/2018

Combining Axiom Injection and Knowledge Base Completion for Efficient Natural Language Inference

In logic-based approaches to reasoning tasks such as Recognizing Textual...
research
03/13/2014

Scalable and Robust Construction of Topical Hierarchies

Automated generation of high-quality topical hierarchies for a text coll...
research
02/01/2019

StaTIX - Statistical Type Inference on Linked Data

Large knowledge bases typically contain data adhering to various schemas...

Please sign up or login with your details

Forgot password? Click here to reset