NLP-based detection of systematic anomalies among the narratives of consumer complaints

08/22/2023
by   Peiheng Gao, et al.
0

We develop an NLP-based procedure for detecting systematic nonmeritorious consumer complaints, simply called systematic anomalies, among complaint narratives. While classification algorithms are used to detect pronounced anomalies, in the case of smaller and frequent systematic anomalies, the algorithms may falter due to a variety of reasons, including technical ones as well as natural limitations of human analysts. Therefore, as the next step after classification, we convert the complaint narratives into quantitative data, which are then analyzed using an algorithm for detecting systematic anomalies. We illustrate the entire procedure using complaint narratives from the Consumer Complaint Database of the Consumer Financial Protection Bureau.

READ FULL TEXT
research
10/27/2021

Systematic definition and classification of data anomalies in DBMS (English Version)

There is no unified definition of Data anomalies, which refers to the sp...
research
06/05/2018

A linear time method for the detection of point and collective anomalies

The challenge of efficiently identifying anomalies in data sequences is ...
research
07/18/2018

Latent Dirichlet Allocation (LDA) for Topic Modeling of the CFPB Consumer Complaints

A text mining approach is proposed based on latent Dirichlet allocation ...
research
11/20/2020

Detecting systematic anomalies affecting systems when inputs are stationary time series

We develop an anomaly detection method when systematic anomalies are aff...
research
08/02/2023

LLMs Understand Glass-Box Models, Discover Surprises, and Suggest Repairs

We show that large language models (LLMs) are remarkably good at working...
research
02/12/2023

On the Existence of Anomalies

The Independence Postulate (IP) is a finitary Church-Turing Thesis, sayi...

Please sign up or login with your details

Forgot password? Click here to reset