A Sensitivity Analysis of Pathfinder: A Follow-up Study

03/20/2013
by   Keung-Chi Ng, et al.
0

At last year?s Uncertainty in AI Conference, we reported the results of a sensitivity analysis study of Pathfinder. Our findings were quite unexpected-slight variations to Pathfinder?s parameters appeared to lead to substantial degradations in system performance. A careful look at our first analysis, together with the valuable feedback provided by the participants of last year?s conference, led us to conduct a follow-up study. Our follow-up differs from our initial study in two ways: (i) the probabilities 0.0 and 1.0 remained unchanged, and (ii) the variations to the probabilities that are close to both ends (0.0 or 1.0) were less than the ones close to the middle (0.5). The results of the follow-up study look more reasonable-slight variations to Pathfinder?s parameters now have little effect on its performance. Taken together, these two sets of results suggest a viable extension of a common decision analytic sensitivity analysis to the larger, more complex settings generally encountered in artificial intelligence.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/04/2012

Exploiting Evidence-dependent Sensitivity Bounds

Studying the effects of one-way variation of any number of parameters on...
research
09/11/2015

Measuring an Artificial Intelligence System's Performance on a Verbal IQ Test For Young Children

We administered the Verbal IQ (VIQ) part of the Wechsler Preschool and P...
research
12/07/2015

Sensitivity analysis, multilinearity and beyond

Sensitivity methods for the analysis of the outputs of discrete Bayesian...
research
03/27/2013

A Sensitivity Analysis of Pathfinder

Knowledge elicitation is one of the major bottlenecks in expert system d...
research
10/03/2022

A general framework for probabilistic sensitivity analysis with respect to distribution parameters

Probabilistic sensitivity analysis identifies the influential uncertain ...
research
08/07/2014

When do Numbers Really Matter?

Common wisdom has it that small distinctions in the probabilities quanti...

Please sign up or login with your details

Forgot password? Click here to reset