DeepAI
Log In Sign Up

FaiR-IoT: Fairness-aware Human-in-the-Loop Reinforcement Learning for Harnessing Human Variability in Personalized IoT

03/30/2021
by   Salma Elmalaki, et al.
0

Thanks to the rapid growth in wearable technologies, monitoring complex human context becomes feasible, paving the way to develop human-in-the-loop IoT systems that naturally evolve to adapt to the human and environment state autonomously. Nevertheless, a central challenge in designing such personalized IoT applications arises from human variability. Such variability stems from the fact that different humans exhibit different behaviors when interacting with IoT applications (intra-human variability), the same human may change the behavior over time when interacting with the same IoT application (inter-human variability), and human behavior may be affected by the behaviors of other people in the same environment (multi-human variability). To that end, we propose FaiR-IoT, a general reinforcement learning-based framework for adaptive and fairness-aware human-in-the-loop IoT applications. In FaiR-IoT, three levels of reinforcement learning agents interact to continuously learn human preferences and maximize the system's performance and fairness while taking into account the intra-, inter-, and multi-human variability. We validate the proposed framework on two applications, namely (i) Human-in-the-Loop Automotive Advanced Driver Assistance Systems and (ii) Human-in-the-Loop Smart House. Results obtained on these two applications validate the generality of FaiR-IoT and its ability to provide a personalized experience while enhancing the system's performance by 40 enhancing the fairness of the multi-human systems by 1.5 orders of magnitude.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/12/2018

Machine Learning-based Variability Handling in IoT Agents

Agent-based IoT applications have recently been proposed in several doma...
02/14/2021

Reinforcement Learning for IoT Security: A Comprehensive Survey

The number of connected smart devices has been increasing exponentially ...
12/14/2018

An IoT Analytics Embodied Agent Model based on Context-Aware Machine Learning

Agent-based Internet of Things (IoT) applications have recently emerged ...
10/31/2019

Learning Fairness in Multi-Agent Systems

Fairness is essential for human society, contributing to stability and p...
05/20/2022

Survey on Fair Reinforcement Learning: Theory and Practice

Fairness-aware learning aims at satisfying various fairness constraints ...
02/03/2022

VindiCo: Privacy Safeguard Against Adaptation Based Spyware in Human-in-the-Loop IoT

Personalized IoT adapts their behavior based on contextual information, ...
05/27/2020

IoT-based Emergency Evacuation Systems

Fires, earthquakes, floods, hurricanes, overcrowding, or and even pandem...