Past, Present and Future of Hadoop: A Survey

02/27/2022
by   Ameneh Zarei, et al.
0

In this paper, a technology for massive data storage and computing named Hadoop is surveyed. Hadoop consists of heterogeneous computing devices like regular PCs abstracting away the details of parallel processing and developers can just concentrate on their computational problem. A Hadoop cluster is made of two parts: HDFs and Mapreduce. Hadoop cluster uses HDFS for data management. HDFS provides storage for input and output data in MapReduce jobs and is designed with abilities like high-fault tolerance, high-distribution capacity, and high throughput. It is also suitable for storing Terabyte data on clusters and it runs on flexible hardware like commodity devices.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/14/2020

Cloud Storage Architecture: Research Challenges and Opportunities

From home appliances to industrial enterprises, the Information and Comm...
research
04/01/2021

Investigating the Reliability in Three RAID Storage Models and Effect of Ordering Replicas on Disks

One of the most important parts of cloud computing is storage devices, a...
research
06/28/2022

Get Your Memory Right: The Crispy Resource Allocation Assistant for Large-Scale Data Processing

Distributed dataflow systems like Apache Spark and Apache Hadoop enable ...
research
09/16/2018

I/O Workload Management for All-Flash Datacenter Storage Systems Based on Total Cost of Ownership

Recently, the capital expenditure of flash-based Solid State Driver (SSD...
research
02/06/2018

RDMAvisor: Toward Deploying Scalable and Simple RDMA as a Service in Datacenters

RDMA is increasingly adopted by cloud computing platforms to provide low...
research
07/31/2019

Deploying a Top-100 Supercomputer for Large Parallel Workloads: the Niagara Supercomputer

Niagara is currently the fastest supercomputer accessible to academics i...
research
05/11/2022

Key-Value Stores on Flash Storage Devices: A Survey

Key-value stores (KV) have become one of the main components of the mode...

Please sign up or login with your details

Forgot password? Click here to reset