Cancer Hallmark Classification Using Bidirectional Encoder Representations From Transformers

05/02/2023
by   Sultan Zavrak, et al.
0

This paper presents a novel approach to accurately classify the hallmarks of cancer, which is a crucial task in cancer research. Our proposed method utilizes the Bidirectional Encoder Representations from Transformers (BERT) architecture, which has shown exceptional performance in various downstream applications. By applying transfer learning, we fine-tuned the pre-trained BERT model on a small corpus of biomedical text documents related to cancer. The outcomes of our experimental investigations demonstrate that our approach attains a noteworthy accuracy of 94.45 with a substantial increase of at least 8.04 These findings highlight the effectiveness of our proposed model in accurately classifying and comprehending text documents for cancer research, thus contributing significantly to the field. As cancer remains one of the top ten leading causes of death globally, our approach holds great promise in advancing cancer research and improving patient outcomes.

READ FULL TEXT

page 6

page 9

research
05/14/2020

A pre-training technique to localize medical BERT and enhance BioBERT

Bidirectional Encoder Representations from Transformers (BERT) models fo...
research
08/09/2019

BERT-based Ranking for Biomedical Entity Normalization

Developing high-performance entity normalization algorithms that can all...
research
09/17/2020

DSC IIT-ISM at SemEval-2020 Task 6: Boosting BERT with Dependencies for Definition Extraction

We explore the performance of Bidirectional Encoder Representations from...
research
01/31/2022

Learning affective meanings that derives the social behavior using Bidirectional Encoder Representations from Transformers

Predicting the outcome of a process requires modeling the system dynamic...
research
03/14/2022

Can pre-trained Transformers be used in detecting complex sensitive sentences? – A Monsanto case study

Each and every organisation releases information in a variety of forms r...
research
05/05/2019

Investigating the Successes and Failures of BERT for Passage Re-Ranking

The bidirectional encoder representations from transformers (BERT) model...
research
04/09/2021

BERT-based Chinese Text Classification for Emergency Domain with a Novel Loss Function

This paper proposes an automatic Chinese text categorization method for ...

Please sign up or login with your details

Forgot password? Click here to reset