Towards Big data processing in IoT: network management for online edge data processing

05/05/2019
by   Shuo Wan, et al.
0

Heavy data load and wide cover range have always been crucial problems for internet of things (IoT). However, in mobile-edge computing (MEC) network, the huge data can be partly processed at the edge. In this paper, a MEC-based big data analysis network is discussed. The raw data generated by distributed network terminals are collected and processed by edge servers. The edge servers split out a large sum of redundant data and transmit extracted information to the center cloud for further analysis. However, for consideration of limited edge computation ability, part of the raw data in huge data sources may be directly transmitted to the cloud. To manage limited resources online, we propose an algorithm based on Lyapunov optimization to jointly optimize the policy of edge processor frequency, transmission power and bandwidth allocation. The algorithm aims at stabilizing data processing delay and saving energy without knowing probability distributions of data sources. The proposed network management algorithm may contribute to big data processing in future IoT.

READ FULL TEXT
research
06/12/2019

Towards Big data processing in IoT: Path Planning and Resource Management of UAV Base Stations in Mobile-Edge Computing System

Heavy data load and wide cover range have always been crucial problems f...
research
04/03/2020

Localized Mobile Agent Framework for data processing on Internet of Things

Internet of Things (IoT) is the major research filed in the recent trend...
research
11/21/2017

Optimal Task Allocation in Near-Far Computing Enhanced C-RAN for Wireless Big Data Processing

With the increasing popularity of user equipments (UEs), the correspondi...
research
02/02/2022

Data Processing Framework for Ship Performance Analysis

The hydrodynamic performance of a sea-going ship can be analysed using t...
research
08/17/2020

Probabilistic Skyline Query Processing over Uncertain Data Streams in Edge Computing Environments

With the advancement of technology, the data generated in our lives is g...
research
08/15/2020

Damage Detection in Bridge Structures: An Edge Computing Approach

Wireless sensor network (WSN) based SHM systems have shown significant i...
research
03/14/2023

Lotus: Serverless In-Transit Data Processing for Edge-based Pub/Sub

Publish-subscribe systems are a popular approach for edge-based IoT use ...

Please sign up or login with your details

Forgot password? Click here to reset