Hier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.

Optimizing Parametrized Information Bottleneck Compression Mappings with Genetic Algorithms

: Lewandowsky, J.; Dongare, S.J.; Adrat, M.; Schrammen, M.; Jax, P.


Wysocki, Tadeusz A. (Ed.) ; Institute of Electrical and Electronics Engineers -IEEE-; IEEE Communications Society:
14th International Conference on Signal Processing and Communication Systems, ICSPCS 2020. Proceedings : December 14-16, 2020, virtual conference
Piscataway, NJ: IEEE, 2020
ISBN: 978-1-7281-9973-3
ISBN: 978-1-7281-9971-9
ISBN: 978-1-7281-9972-6
International Conference on Signal Processing and Communication Systems (ICSPCS) <14, 2020, Online>
Fraunhofer FKIE ()

Preserving relevant mutual information under compression is the fundamental challenge of the information bottleneck method and has numerous applications in machine learning and in communications. The literature describes very successful applications of this concept in quantized detection and channel decoding schemes. The resulting receiver algorithms only use simple lookup tables and process quantization indices, but can achieve performance close to that of conventional high-precision systems. In some applications, however, it is desirable to design a parametrized compression rule instead of a possibly huge lookup table. Genetic algorithms are very powerful generic optimization algorithms which are inspired from the natural evolution of the species. In this paper, we show that genetic algorithms can be used to optimize parametrized compression mappings that aim for maximum preservation of relevant information, especially in cases where standard optimization methods cannot be applied straightforwardly. We exemplarily investigate the receiver-sided channel output quantization as an important application in communications to illustrate the notable performance and the flexibility of the proposed concept.