IntelligentCrowd: Mobile Crowdsensing via Multi-agent Reinforcement Learning

09/20/2018
by   Yize Chen, et al.
0

The prosperity of smart mobile devices has made mobile crowdsensing (MCS) a promising paradigm for completing complex sensing and computation tasks. In the past, great efforts have been made on the design of incentive mechanisms and task allocation strategies from MCS platform's perspective to motivate mobile users' participation. However, in practice, MCS participants face many uncertainties coming from their sensing environment as well as other participants' strategies, and how do they interact with each other and make sensing decisions is not well understood. In this paper, we take MCS participants' perspective to derive an online sensing policy to maximize their payoffs via MCS participation. Specifically, we model the interactions of mobile users and sensing environments as a multi-agent Markov decision process. Each participant cannot observe others' decisions, but needs to decide her effort level in sensing tasks only based on local information, e.g., its own record of sensed signals' quality. To cope with the stochastic sensing environment, we develop an intelligent crowdsensing algorithm IntelligentCrowd by leveraging the power of multi-agent reinforcement learning (MARL). Our algorithm leads to the optimal sensing policy for each user to maximize the expected payoff against stochastic sensing environments, and can be implemented at individual participant's level in a distributed fashion. Numerical simulations demonstrate that IntelligentCrowd significantly improves users' payoffs in sequential MCS tasks under various sensing dynamics.

READ FULL TEXT

page 1

page 4

page 5

page 6

research
11/16/2020

Scalable Reinforcement Learning Policies for Multi-Agent Control

This paper develops a stochastic Multi-Agent Reinforcement Learning (MAR...
research
07/02/2019

Voting-Based Multi-Agent Reinforcement Learning

The recent success of single-agent reinforcement learning (RL) encourage...
research
07/23/2018

A Stackelberg Game Approach Towards Socially-Aware Incentive Mechanisms for Mobile Crowdsensing (Online report)

Mobile crowdsensing has shown a great potential to address large-scale d...
research
12/08/2018

Crowdsensing Game with Demand Uncertainties: A Deep Reinforcement Learning Approach

Currently, explosive increase of smartphones with powerful built-in sens...
research
02/10/2021

ParmoSense: A Scenario-based Participatory Mobile Urban Sensing Platform with User Motivation Engine

Rapid proliferation of mobile devices with various sensors have enabled ...
research
11/28/2019

Stigmergic Independent Reinforcement Learning for Multi-Agent Collaboration

With the rapid evolution of wireless mobile devices, it emerges stronger...
research
02/22/2023

Semantic Information Marketing in The Metaverse: A Learning-Based Contract Theory Framework

In this paper, we address the problem of designing incentive mechanisms ...

Please sign up or login with your details

Forgot password? Click here to reset