Calibrating AI Models for Few-Shot Demodulation via Conformal Prediction

10/10/2022
by   Kfir M. Cohen, et al.
0

AI tools can be useful to address model deficits in the design of communication systems. However, conventional learning-based AI algorithms yield poorly calibrated decisions, unabling to quantify their outputs uncertainty. While Bayesian learning can enhance calibration by capturing epistemic uncertainty caused by limited data availability, formal calibration guarantees only hold under strong assumptions about the ground-truth, unknown, data generation mechanism. We propose to leverage the conformal prediction framework to obtain data-driven set predictions whose calibration properties hold irrespective of the data distribution. Specifically, we investigate the design of baseband demodulators in the presence of hard-to-model nonlinearities such as hardware imperfections, and propose set-based demodulators based on conformal prediction. Numerical results confirm the theoretical validity of the proposed demodulators, and bring insights into their average prediction set size efficiency.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/15/2022

Calibrating AI Models for Wireless Communications via Conformal Prediction

When used in complex engineered systems, such as communication networks,...
research
10/06/2022

Few-Shot Calibration of Set Predictors via Meta-Learned Cross-Validation-Based Conformal Prediction

Conventional frequentist learning is known to yield poorly calibrated mo...
research
05/12/2023

Calibration-Aware Bayesian Learning

Deep learning models, including modern systems like large language model...
research
07/01/2022

Robust Bayesian Learning for Reliable Wireless AI: Framework and Applications

This work takes a critical look at the application of conventional machi...
research
05/27/2021

Calibrating Over-Parametrized Simulation Models: A Framework via Eligibility Set

Stochastic simulation aims to compute output performance for complex mod...
research
09/16/2023

Data-driven Reachability using Christoffel Functions and Conformal Prediction

An important mathematical tool in the analysis of dynamical systems is t...
research
08/17/2016

A Bayesian Network approach to County-Level Corn Yield Prediction using historical data and expert knowledge

Crop yield forecasting is the methodology of predicting crop yields prio...

Please sign up or login with your details

Forgot password? Click here to reset