Combinative Cumulative Knowledge Processes

09/11/2023
by   Anna Brandenberger, et al.
0

We analyze Cumulative Knowledge Processes, introduced by Ben-Eliezer, Mikulincer, Mossel, and Sudan (ITCS 2023), in the setting of "directed acyclic graphs", i.e., when new units of knowledge may be derived by combining multiple previous units of knowledge. The main considerations in this model are the role of errors (when new units may be erroneous) and local checking (where a few antecedent units of knowledge are checked when a new unit of knowledge is discovered). The aforementioned work defined this model but only analyzed an idealized and simplified "tree-like" setting, i.e., a setting where new units of knowledge only depended directly on one previously generated unit of knowledge. The main goal of our work is to understand when the general process is safe, i.e., when the effect of errors remains under control. We provide some necessary and some sufficient conditions for safety. As in the earlier work, we demonstrate that the frequency of checking as well as the depth of the checks play a crucial role in determining safety. A key new parameter in the current work is the combination factor which is the distribution of the number of units M of old knowledge that a new unit of knowledge depends on. Our results indicate that a large combination factor can compensate for a small depth of checking. The dependency of the safety on the combination factor is far from trivial. Indeed some of our main results are stated in terms of 𝔼{1/M} while others depend on 𝔼{M}.

READ FULL TEXT

page 8

page 27

page 28

research
03/14/2018

Building Sparse Deep Feedforward Networks using Tree Receptive Fields

Sparse connectivity is an important factor behind the success of convolu...
research
06/13/2018

Model-Based Safety-Cases for Software-Intensive Systems

Safety cases become increasingly important for software certification. M...
research
10/21/2020

Multi-Unit Transformers for Neural Machine Translation

Transformer models achieve remarkable success in Neural Machine Translat...
research
05/27/2022

Safety Aware Changepoint Detection for Piecewise i.i.d. Bandits

In this paper, we consider the setting of piecewise i.i.d. bandits under...
research
08/31/2010

Mixed Cumulative Distribution Networks

Directed acyclic graphs (DAGs) are a popular framework to express multiv...
research
11/22/2020

Towards Class-Specific Unit

Class selectivity is an attribute of a unit in deep neural networks, whi...
research
11/23/2021

Identifying the Units of Measurement in Tabular Data

We consider the problem of identifying the units of measurement in a dat...

Please sign up or login with your details

Forgot password? Click here to reset