Statistical Inference, Learning and Models in Big Data

09/09/2015
by   Beate Franke, et al.
0

The need for new methods to deal with big data is a common theme in most scientific fields, although its definition tends to vary with the context. Statistical ideas are an essential part of this, and as a partial response, a thematic program on statistical inference, learning, and models in big data was held in 2015 in Canada, under the general direction of the Canadian Statistical Sciences Institute, with major funding from, and most activities located at, the Fields Institute for Research in Mathematical Sciences. This paper gives an overview of the topics covered, describing challenges and strategies that seem common to many different areas of application, and including some examples of applications to make these challenges and strategies more concrete.

READ FULL TEXT

page 8

page 14

research
03/26/2020

Data Integration by combining big data and survey sample data for finite population inference

The statistical challenges in using big data for making valid statistica...
research
07/07/2017

InferSpark: Statistical Inference at Scale

The Apache Spark stack has enabled fast large-scale data processing. Des...
research
04/20/2020

On The Problem of Relevance in Statistical Inference

How many statistical inference tools we have for inference from massive ...
research
03/30/2021

Scalable Statistical Inference of Photometric Redshift via Data Subsampling

Handling big data has largely been a major bottleneck in traditional sta...
research
09/25/2021

Statistical Inference for Data Integration

In the age of big data, data integration is a critical step especially i...
research
12/21/2018

The future of statistical disclosure control

Statistical disclosure control (SDC) was not created in a single seminal...
research
08/26/2020

Optimization for Supervised Machine Learning: Randomized Algorithms for Data and Parameters

Many key problems in machine learning and data science are routinely mod...

Please sign up or login with your details

Forgot password? Click here to reset