Theory-plus-code documentation of the DEPAM workflow for soundscape description

02/14/2019
by   D. Cazau, et al.
0

In the Big Data era, the community of PAM faces strong challenges, including the need for more standardized processing tools accross its different applications in oceanography, and for more scalable and high-performance computing systems to process more efficiently the everly growing datasets. In this work we address conjointly both issues by first proposing a detailed theory-plus-code document of a classical analysis workflow to describe the content of PAM data, which hopefully will be reviewed and adopted by a maximum of PAM experts to make it standardized. Second, we transposed this workflow into the Scala language within the Spark/Hadoop frameworks so it can be directly scaled out on several node cluster.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/07/2018

MaRe: Container-Based Parallel Computing with Data Locality

Application containers are emerging as key components in scientific proc...
research
04/05/2018

Big enterprise registration data imputation: Supporting spatiotemporal analysis of industries in China

Big, fine-grained enterprise registration data that includes time and lo...
research
01/11/2018

BioWorkbench: A High-Performance Framework for Managing and Analyzing Bioinformatics Experiments

Advances in sequencing techniques have led to exponential growth in biol...
research
10/06/2022

WfBench: Automated Generation of Scientific Workflow Benchmarks

The prevalence of scientific workflows with high computational demands c...
research
01/19/2022

Workflows Community Summit: Tightening the Integration between Computing Facilities and Scientific Workflows

The importance of workflows is highlighted by the fact that they have un...
research
01/22/2019

Using Big Data Technologies for HEP Analysis

The HEP community is approaching an era were the excellent performances ...
research
09/29/2017

Toward a System Building Agenda for Data Integration

In this paper we argue that the data management community should devote ...

Please sign up or login with your details

Forgot password? Click here to reset