Utilizing a digital swarm intelligence platform to improve consensus among radiologists and exploring its applications

06/26/2021
by   Rutwik Shah, et al.
0

Radiologists today play a key role in making diagnostic decisions and labeling images for training A.I. algorithms. Low inter-reader reliability (IRR) can be seen between experts when interpreting challenging cases. While teams-based decisions are known to outperform individual decisions, inter-personal biases often creep up in group interactions which limit non-dominant participants from expressing true opinions. To overcome the dual problems of low consensus and inter-personal bias, we explored a solution modeled on biological swarms of bees. Two separate cohorts; three radiologists and five radiology residents collaborated on a digital swarm platform in real time and in a blinded fashion, grading meniscal lesions on knee MR exams. These consensus votes were benchmarked against clinical (arthroscopy) and radiological (senior-most radiologist) observations. The IRR of the consensus votes was compared to the IRR of the majority and most confident votes of the two cohorts.The radiologist cohort saw an improvement of 23 votes over majority vote. Similar improvement of 23 votes over majority vote, was observed. The 5-resident swarm had an even higher improvement of 32 improved specificity by up to 50 individual and majority vote decisions in both the radiologists and resident cohorts. The 5-resident swarm had higher IRR than 3-resident swarm indicating positive effect of increased swarm size. The attending and resident swarms also outperformed predictions from a state-of-the-art A.I. algorithm. Utilizing a digital swarm platform improved agreement and allows participants to express judgement free intent, resulting in superior clinical performance and robust A.I. training labels.

READ FULL TEXT
research
09/18/2022

Too Global To Be Local: Swarm Consensus in Adversarial Settings

Reaching a consensus in a swarm of robots is one of the fundamental prob...
research
10/24/2012

Towards Swarm Calculus: Urn Models of Collective Decisions and Universal Properties of Swarm Performance

Methods of general applicability are searched for in swarm intelligence ...
research
12/13/2021

Swarm consensus

The strength of gnomes lies in their coordinated action. Being small and...
research
12/08/2020

Improved Swarm Engineering: Aligning Intuition and Analysis

When designing swarm-robotic systems, systematic comparison of swarm con...
research
04/03/2017

Design and development of a software system for swarm intelligence based research studies

This paper introduce a software system including widely-used Swarm Intel...
research
04/08/2022

Swarm Modelling with Dynamic Mode Decomposition

Modelling biological or engineering swarms is challenging due to the inh...
research
03/22/2018

The Roots of Bias on Uber

In the last decade, there has been a growth in, what we call, digitally ...

Please sign up or login with your details

Forgot password? Click here to reset