AI Chat AI Image Generator AI Video Text to Speech

BERT: A Review of Applications in Natural Language Processing and Understanding

03/22/2021

∙

by M. V. Koroteev, et al.

∙

∙

In this review, we describe the application of one of the most popular deep learning-based language models - BERT. The paper describes the mechanism of operation of this model, the main areas of its application to the tasks of text analytics, comparisons with similar models in each task, as well as a description of some proprietary models. In preparing this review, the data of several dozen original scientific articles published over the past few years, which attracted the most attention in the scientific community, were systematized. This survey will be useful to all students and researchers who want to get acquainted with the latest advances in the field of natural language text analysis.

research

∙ 07/18/2022

BERT: A Review of Natural Language Processing and Understanding Applications

We cover the use of BERT, one of the most well-liked deep learning-based...

0 vl-otchenash, et al. ∙

research

∙ 02/20/2019

ScispaCy: Fast and Robust Models for Biomedical Natural Language Processing

Despite recent advances in natural language processing, many statistical...

0 Mark Neumann, et al. ∙

research

∙ 08/31/2023

Using Large Language Models to Automate Category and Trend Analysis of Scientific Articles: An Application in Ophthalmology

Purpose: In this paper, we present an automated method for article class...

0 Hina Raja, et al. ∙

research

∙ 10/01/2020

A survey on natural language processing (nlp) and applications in insurance

Text is the most widely used means of communication today. This data is ...

0 Antoine Ly, et al. ∙

research

∙ 02/04/2019

Attention, please! A Critical Review of Neural Attention Models in Natural Language Processing

Attention is an increasingly popular mechanism used in a wide range of n...

0 Andrea Galassi, et al. ∙

research

∙ 04/01/2020

A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects

Convolutional Neural Network (CNN) is one of the most significant networ...

0 Zewen Li, et al. ∙

research

∙ 12/24/2021

nvBench: A Large-Scale Synthesized Dataset for Cross-Domain Natural Language to Visualization Task

NL2VIS - which translates natural language (NL) queries to corresponding...

0 Yuyu Luo, et al. ∙