Entropy-Constrained Maximizing Mutual Information Quantization

01/07/2020
by   Thuan Nguyen, et al.
0

In this paper, we investigate the quantization of the output of a binary input discrete memoryless channel that maximizing the mutual information between the input and the quantized output under an entropy-constrained of the quantized output. A polynomial time algorithm is introduced that can find the truly global optimal quantizer. These results hold for binary input channels with an arbitrary number of quantized output. Finally, we extend these results to binary input continuous output channels and show a sufficient condition such that a single threshold quantizer is an optimal quantizer. Both theoretical results and numerical results are provided to justify our techniques.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/07/2020

Single-bit Quantization Capacity of Binary-input Continuous-output Channels

We consider a channel with discrete binary input X that is corrupted by ...
research
01/08/2020

Optimal quantizer structure for binary discrete input continuous output channels under an arbitrary quantized-output constraint

Given a channel having binary input X = (x_1, x_2) having the probabilit...
research
01/07/2020

On the Uniqueness of Binary Quantizers for Maximizing Mutual Information

We consider a channel with a binary input X being corrupted by a continu...
research
01/07/2019

Dynamic Programming for Discrete Memoryless Channel Quantization

In this paper, we present a general framework for applying dynamic progr...
research
11/25/2022

Homology-constrained vector quantization entropy regularizer

This paper describes an entropy regularization term for vector quantizat...
research
04/08/2020

Learning Discrete Structured Representations by Adversarially Maximizing Mutual Information

We propose learning discrete structured representations from unlabeled d...
research
12/07/2018

Information-Distilling Quantizers

Let X and Y be dependent random variables. This paper considers the prob...

Please sign up or login with your details

Forgot password? Click here to reset