A Fair and Efficient Hybrid Federated Learning Framework based on XGBoost for Distributed Power Prediction

01/08/2022
by   Haizhou Liu, et al.
2

In a modern power system, real-time data on power generation/consumption and its relevant features are stored in various distributed parties, including household meters, transformer stations and external organizations. To fully exploit the underlying patterns of these distributed data for accurate power prediction, federated learning is needed as a collaborative but privacy-preserving training scheme. However, current federated learning frameworks are polarized towards addressing either the horizontal or vertical separation of data, and tend to overlook the case where both are present. Furthermore, in mainstream horizontal federated learning frameworks, only artificial neural networks are employed to learn the data patterns, which are considered less accurate and interpretable compared to tree-based models on tabular datasets. To this end, we propose a hybrid federated learning framework based on XGBoost, for distributed power prediction from real-time external features. In addition to introducing boosted trees to improve accuracy and interpretability, we combine horizontal and vertical federated learning, to address the scenario where features are scattered in local heterogeneous parties and samples are scattered in various local districts. Moreover, we design a dynamic task allocation scheme such that each party gets a fair share of information, and the computing power of each party can be fully leveraged to boost training efficiency. A follow-up case study is presented to justify the necessity of adopting the proposed framework. The advantages of the proposed framework in fairness, efficiency and accuracy performance are also confirmed.

READ FULL TEXT

page 1

page 8

page 9

research
03/22/2021

A Federated Learning Framework in Smart Grid: Securing Power Traces in Collaborative Learning

With the deployment of smart sensors and advancements in communication t...
research
09/13/2021

FedFair: Training Fair Models In Cross-Silo Federated Learning

Building fair machine learning models becomes more and more important. A...
research
03/08/2023

Distributed and Deep Vertical Federated Learning with Big Data

In recent years, data are typically distributed in multiple organization...
research
04/01/2021

PyVertical: A Vertical Federated Learning Framework for Multi-headed SplitNN

We introduce PyVertical, a framework supporting vertical federated learn...
research
11/09/2020

Interpretable collaborative data analysis on distributed data

This paper proposes an interpretable non-model sharing collaborative dat...
research
05/20/2021

Fed-EINI: An Efficient and Interpretable Inference Framework for Decision Tree Ensembles in Federated Learning

The increasing concerns about data privacy and security drives the emerg...
research
08/26/2022

Flexible Vertical Federated Learning with Heterogeneous Parties

We propose Flexible Vertical Federated Learning (Flex-VFL), a distribute...

Please sign up or login with your details

Forgot password? Click here to reset