Evaluation of a Bi-Directional Methodology for Automated Assessment of Compliance to Continuous Application of Clinical Guidelines, in the Type 2 Diabetes-Management Domain

03/16/2021
by   Avner Hatsek, et al.
0

We evaluated the DiscovErr system, in which we had previously implemented a new methodology for assessment of compliance to continuous application of evidence-based clinical guidelines, based on a bidirectional search from the guideline objectives to the patient's longitudinal data, and vice versa. We compared the system comments on 1584 transactions regarding the management, over a mean of 5.23 years, of 10 randomly selected Type 2 diabetes patients, to those of two diabetes experts and a senior family practitioner. After providing their own comments, the experts assessed both the correctness (precision) and the importance of each of the DiscovErr system comments. The completeness (recall or coverage) of the system was computed by comparing its comments to those made by the experts. The system made 279 comments. The experts made 181 unique comments. The completeness of the system was 91 made by at least two experts, and 98 three. 172 comments were evaluated by the experts for correctness and importance: All 114 medication-related comments, and a random 35 monitoring-related comments. The system's correctness was 81 comments judged as correct by both diabetes experts, and 91 comments judged as correct by a diabetes expert and at least as partially correct by the other. 89 diabetes experts, 8 less important by both experts. The completeness scores of the three experts (compared to the comments of all experts plus the validated system comments) were 75 majority) were respectively 99 DiscovErr can assess the quality of continuous guideline-based care.

READ FULL TEXT
research
03/13/2021

A Methodology for Bi-Directional Knowledge-Based Assessment of Compliance to Continuous Application of Clinical Guidelines

Clinicians often do not sufficiently adhere to evidence-based clinical g...
research
11/23/2022

Implementation and Evaluation of a System for Assessment of The Quality of Long-Term Management of Patients at a Geriatric Hospital

Background The use of a clinical decision support system for assessing...
research
12/05/2021

A comment-driven evidence appraisal approach for decision-making when only uncertain evidence available

Purpose: To explore whether comments could be used as an assistant tool ...
research
09/18/2018

Improving Moderation of Online Discussions via Interpretable Neural Models

Growing amount of comments make online discussions difficult to moderate...
research
04/01/2019

Does the hiding mechanism for Stack Overflow comments work well? No!

Stack Overflow has accumulated millions of answers. Informative comments...
research
05/23/2020

What do class comments tell us? An investigation of comment evolution and practices in Pharo

Previous studies have characterized code comments in different programmi...
research
07/25/2019

Validating and Updating GRASP: A New Evidence-Based Framework for Grading and Assessment of Clinical Predictive Tools

Background: When selecting predictive tools, for implementation in clini...

Please sign up or login with your details

Forgot password? Click here to reset