DeepAI
Log In Sign Up

Modular interface for managing cognitive bias in experts

08/08/2022
by   Melody G Whitehead, et al.
0

Expert knowledge is required to interpret data across a range of fields. Experts bridge gaps that often exists in our knowledge about relationships between data and the parameters of interest. This is especially true in geoscientific applications, where knowledge of the Earth is derived from interpretations of observable features and relies on predominantly unproven but widely accepted theories. Thus, experts facilitate solutions to otherwise unsolvable problems. However, experts are inherently subjective, and susceptible to cognitive biases and adverse external effects. This work examines this problem within geoscience. Three compelling examples are provided of the prevalence of cognitive biases from previous work. The problem is then formally defined, and a set of design principles which ensure that any solution is sufficiently flexible to be readily applied to the range of geoscientific problems. No solutions exist that reliably capture and reduce cognitive bias in experts. However, formal expert elicitation methods can be used to assess expert variation, and a variety of approaches exist that may help to illuminate uncertainties, avoid misunderstandings, and reduce herding behaviours or single-expert over-dominance. This work combines existing and future approaches to reduce expert suboptimality through a flexible modular design where each module provides a specific function. The design centres around action modules that force a stop-and-perform step into interpretation tasks. A starter-pack of modules is provided as an example of the conceptual design. This simple bias-reduction system may readily be applied in organisations and during everyday interpretations through to tasks for major commercial ventures.

READ FULL TEXT

page 1

page 2

page 3

page 4

01/07/2020

Revealing Neural Network Bias to Non-Experts Through Interactive Counterfactual Examples

AI algorithms are not immune to biases. Traditionally, non-experts have ...
11/19/2020

Toward a Bias-Aware Future for Mixed-Initiative Visual Analytics

Mixed-initiative visual analytics systems incorporate well-established d...
06/17/2022

Species Distribution Modeling with Expert Elicitation and Bayesian Calibration

Species distribution models (SDMs) are key tools in ecology, conservatio...
06/30/2022

Personalized Detection of Cognitive Biases in Actions of Users from Their Logs: Anchoring and Recency Biases

Cognitive biases are mental shortcuts humans use in dealing with informa...
08/10/2020

On the Gap between Epidemiological Surveillance and Preparedness

Contemporary Epidemiological Surveillance (ES) relies heavily on data an...
12/12/2019

Screening of Informed and Uninformed Experts

Testing the validity of claims made by self-proclaimed experts can be im...
05/14/2020

Towards Socially Responsible AI: Cognitive Bias-Aware Multi-Objective Learning

Human society had a long history of suffering from cognitive biases lead...