ClinicalGPT: Large Language Models Finetuned with Diverse Medical Data and Comprehensive Evaluation

06/16/2023
by   Guangyu Wang, et al.
0

Large language models have exhibited exceptional performance on various Natural Language Processing (NLP) tasks, leveraging techniques such as the pre-training, and instruction fine-tuning. Despite these advances, their effectiveness in medical applications is limited, due to challenges such as factual inaccuracies, reasoning abilities, and lack grounding in real-world experience. In this study, we present ClinicalGPT, a language model explicitly designed and optimized for clinical scenarios. By incorporating extensive and diverse real-world data, such as medical records, domain-specific knowledge, and multi-round dialogue consultations in the training process, ClinicalGPT is better prepared to handle multiple clinical task. Furthermore, we introduce a comprehensive evaluation framework that includes medical knowledge question-answering, medical exams, patient consultations, and diagnostic analysis of medical records. Our results demonstrate that ClinicalGPT significantly outperforms other models in these tasks, highlighting the effectiveness of our approach in adapting large language models to the critical domain of healthcare.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/12/2023

EriBERTa: A Bilingual Pre-Trained Language Model for Clinical Natural Language Processing

The utilization of clinical reports for various secondary purposes, incl...
research
08/28/2023

DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultation

We propose DISC-MedLLM, a comprehensive solution that leverages Large La...
research
07/28/2023

Med-HALT: Medical Domain Hallucination Test for Large Language Models

This research paper focuses on the challenges posed by hallucinations in...
research
09/15/2023

Data Distribution Bottlenecks in Grounding Language Models to Knowledge Bases

Language models (LMs) have already demonstrated remarkable abilities in ...
research
03/01/2023

Almanac: Knowledge-Grounded Language Models for Clinical Medicine

Large-language models have recently demonstrated impressive zero-shot ca...
research
09/08/2023

Knowledge-tuning Large Language Models with Structured Medical Knowledge Bases for Reliable Response Generation in Chinese

Large Language Models (LLMs) have demonstrated remarkable success in div...

Please sign up or login with your details

Forgot password? Click here to reset