Modular interface for managing cognitive bias in experts

08/08/2022
by   Melody G Whitehead, et al.
0

Expert knowledge is required to interpret data across a range of fields. Experts bridge gaps that often exists in our knowledge about relationships between data and the parameters of interest. This is especially true in geoscientific applications, where knowledge of the Earth is derived from interpretations of observable features and relies on predominantly unproven but widely accepted theories. Thus, experts facilitate solutions to otherwise unsolvable problems. However, experts are inherently subjective, and susceptible to cognitive biases and adverse external effects. This work examines this problem within geoscience. Three compelling examples are provided of the prevalence of cognitive biases from previous work. The problem is then formally defined, and a set of design principles which ensure that any solution is sufficiently flexible to be readily applied to the range of geoscientific problems. No solutions exist that reliably capture and reduce cognitive bias in experts. However, formal expert elicitation methods can be used to assess expert variation, and a variety of approaches exist that may help to illuminate uncertainties, avoid misunderstandings, and reduce herding behaviours or single-expert over-dominance. This work combines existing and future approaches to reduce expert suboptimality through a flexible modular design where each module provides a specific function. The design centres around action modules that force a stop-and-perform step into interpretation tasks. A starter-pack of modules is provided as an example of the conceptual design. This simple bias-reduction system may readily be applied in organisations and during everyday interpretations through to tasks for major commercial ventures.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/07/2020

Revealing Neural Network Bias to Non-Experts Through Interactive Counterfactual Examples

AI algorithms are not immune to biases. Traditionally, non-experts have ...
research
11/19/2020

Toward a Bias-Aware Future for Mixed-Initiative Visual Analytics

Mixed-initiative visual analytics systems incorporate well-established d...
research
06/17/2022

Species Distribution Modeling with Expert Elicitation and Bayesian Calibration

Species distribution models (SDMs) are key tools in ecology, conservatio...
research
06/30/2022

Personalized Detection of Cognitive Biases in Actions of Users from Their Logs: Anchoring and Recency Biases

Cognitive biases are mental shortcuts humans use in dealing with informa...
research
08/10/2020

On the Gap between Epidemiological Surveillance and Preparedness

Contemporary Epidemiological Surveillance (ES) relies heavily on data an...
research
10/26/2021

Combining expert knowledge and neural networks to model environmental stresses in agriculture

In this work we combine representation learning capabilities of neural n...

Please sign up or login with your details

Forgot password? Click here to reset