Fast Mapping onto Census Blocks

05/06/2020
by   Jeremy Kepner, et al.
0

Pandemic measures such as social distancing and contact tracing can be enhanced by rapidly integrating dynamic location data and demographic data. Projecting billions of longitude and latitude locations onto hundreds of thousands of highly irregular demographic census block polygons is computationally challenging in both research and deployment contexts. This paper describes two approaches labeled "simple" and "fast". The simple approach can be implemented in any scripting language (Matlab/Octave, Python, Julia, R) and is easily integrated and customized to a variety of research goals. This simple approach uses a novel combination of hierarchy, sparse bounding boxes, polygon crossing-number, vectorization, and parallel processing to achieve 100,000,000+ projections per second on 100 servers. The simple approach is compact, does not increase data storage requirements, and is applicable to any country or region. The fast approach exploits the thread, vector, and memory optimizations that are possible using a low-level language (C++) and achieves similar performance on a single server. This paper details these approaches with the goal of enabling the broader community to quickly integrate location and demographic data.

READ FULL TEXT
research
11/26/2020

Neural Networks for Pulmonary Disease Diagnosis using Auditory and Demographic Information

Pulmonary diseases impact millions of lives globally and annually. The r...
research
05/28/2023

KoSBi: A Dataset for Mitigating Social Bias Risks Towards Safer Large Language Model Application

Large language models (LLMs) learn not only natural text generation abil...
research
08/25/2022

ProxiTrak: Intelligent Enablement of Social Distancing Contact Tracing for a Safer Workplace in the New Normal

This paper describes an innovative solution that enables the enterprises...
research
07/03/2020

Mapping Datasets to Object Storage System

Access libraries such as ROOT and HDF5 allow users to interact with data...
research
08/28/2018

Residualized Factor Adaptation for Community Social Media Prediction Tasks

Predictive models over social media language have shown promise in captu...
research
06/28/2022

Gradual Soundness: Lessons from Static Python

Context: Gradually-typed languages allow typed and untyped code to inter...
research
10/25/2021

Accelerating Compact Fractals with Tensor Core GPUs

This work presents a GPU thread mapping approach that allows doing fast ...

Please sign up or login with your details

Forgot password? Click here to reset