Publica
Hier finden Sie wissenschaftliche Publikationen aus den FraunhoferInstituten. Uniform Manifold Sampling (UMS): Sampling the maximum entropy PDF
 IEEE transactions on signal processing 65 (2017), No.9, pp.24552470 ISSN: 00963518 ISSN: 00189278 ISSN: 00961620 ISSN: 1053587X 

 English 
 Journal Article 
 Fraunhofer FKIE () 
Abstract
Maximum entropy PDF projection (MEPP) is a way to construct generative models from feature transformations. Corresponding to each dimensionreducing feature mapping, such as a feedforward neural network or an algorithm to calculate linearprediction coefficients from time series, and given a prior distribution for the features, there exists a unique generative model for the input data, which subject to mild requirements, is maximum entropy (MaxEnt) among all probability density functions (PDFs) that are consistent with the given feature prior. In this paper, we consider the problem of sampling from these MaxEnt projected PDFs. The sampling process consists of drawing a sample from the given feature prior distribution, then drawing samples uniformly distributed on the inversion set (set of input samples consistent with the drawn feature value, usually a manifold). The process is called uniform manifold sampling (UMS). We describe UMS for simple nonlinear and iterative feature transformations, then focus on linear transformations with input data constraints (xi > 0 or 0 ≤ xi ≤ 1), which require MCMCbased sampling. We discover that the manifold centroid (sample mean for a fixed feature value) is useful as a deterministic MaxEnt feature inversion solution. We show how to predict the centroid efficiently without sampling and demonstrate its usefulness in speeding up MCMC by an order of magnitude, and in spectral estimation and image reconstruction. Finally, we provide an example of UMS in a classification experiment in which we use Monte Carlo integration to create true generative models from arbitrary classifiers.