A Data Streaming Process Framework for Autonomous Driving By Edge

by   Hang Zhao, et al.

In recent years, with the rapid development of sensing technology and the Internet of Things (IoT), sensors play increasingly important roles in traffic control, medical monitoring, industrial production and etc. They generated high volume of data in a streaming way that often need to be processed in real time. Therefore, streaming data computing technology plays an indispensable role in the real-time processing of sensor data in high throughput but low latency. In view of the above problems, the proposed framework is implemented on top of Spark Streaming, which builds up a gray model based traffic flow monitor, a traffic prediction orientated prediction layer and a fuzzy control based Batch Interval dynamic adjustment layer for Spark Streaming. It could forecast the variation of sensors data arrive rate, make streaming Batch Interval adjustment in advance and implement real-time streaming process by edge. Therefore, it can realize the monitor and prediction of the data flow changes of the autonomous driving vehicle sensor data in geographical coverage of edge computing node area, meanwhile minimize the end-to-end latency but satisfy the application throughput requirements. The experiments show that it can predict short-term traffic with no more than 4 consuming rate close to data generating rate, it can maintain system stability well even when arrival data rate changes rapidly. The Batch Interval can be converged to a suitable value in two minutes when data arrival rate is doubled. Compared with vanilla version Spark Streaming, where there has serious task accumulation and introduces large delay, it can reduce 35 Batch Interval when data arrival rate is low; it also can significantly improve system throughput by only at most 25 rate is high.


page 1

page 2

page 3

page 4


eBPF-based Content and Computation-aware Communication for Real-time Edge Computing

By placing computation resources within a one-hop wireless topology, the...

SymED: Adaptive and Online Symbolic Representation of Data on the Edge

The edge computing paradigm helps handle the Internet of Things (IoT) ge...

Real-Time HAP-Assisted Vehicular Edge Computing for Rural Areas

Non-Terrestrial Networks (NTNs) are expected to be a key component of 6t...

Optimizing real-time RDF data streams

The Resource Description Framework (RDF) provides a common data model fo...

Situation Awareness for Autonomous Vehicles Using Blockchain-based Service Cooperation

Efficient Vehicle-to-Everything enabling cooperation and enhanced decisi...

Delay-Constrained Rate Control for Real-Time Video Streaming with Bounded Neural Network

Rate control is widely adopted during video streaming to provide both hi...

Reducing Operation Cost of LPWAN Roadside Sensors Using Cross Technology Communication

Low-Power Wide-Area Network (LPWAN) is an emerging communication standar...

Please sign up or login with your details

Forgot password? Click here to reset