Extracting Entities and Topics from News and Connecting Criminal Records

05/03/2020
by   Quang Pham, et al.
0

The goal of this paper is to summarize methodologies used in extracting entities and topics from a database of criminal records and from a database of newspapers. Statistical models had successfully been used in studying the topics of roughly 300,000 New York Times articles. In addition, these models had also been used to successfully analyze entities related to people, organizations, and places (D Newman, 2006). Additionally, analytical approaches, especially in hotspot mapping, were used in some researches with an aim to predict crime locations and circumstances in the future, and those approaches had been tested quite successfully (S Chainey, 2008). Based on the two above notions, this research was performed with the intention to apply data science techniques in analyzing a big amount of data, selecting valuable intelligence, clustering violations depending on their types of crime, and creating a crime graph that changes through time. In this research, the task was to download criminal datasets from Kaggle and a collection of news articles from Kaggle and EAGER project databases, and then to merge these datasets into one general dataset. The most important goal of this project was performing statistical and natural language processing methods to extract entities and topics as well as to group similar data points into correct clusters, in order to understand public data about U.S related crimes better.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

page 4

page 6

page 12

09/08/2018

Extracting and Analyzing Semantic Relatedness between Cities Using News Articles

News articles capture a variety of topics about our society. They reflec...
09/12/2019

Visualizing Trends of Key Roles in News Articles

There are tons of news articles generated every day reflecting the activ...
03/22/2020

365 Dots in 2019: Quantifying Attention of News Sources

We investigate the overlap of topics of online news articles from a vari...
02/27/2017

Contextualization of topics: Browsing through the universe of bibliographic information

This paper describes how semantic indexing can help to generate a contex...
03/23/2020

How do academic topics shift across altmetric sources? A case study of the research area of Big Data

Taking the research area of Big Data as a case study, we propose an appr...
08/24/2020

On sampling from data with duplicate records

Data deduplication is the task of detecting records in a database that c...
06/03/2021

A protocol to gather, characterize and analyze incoming citations of retracted articles

In this article, we present a methodology which takes as input a collect...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.