PublicaHier finden Sie wissenschaftliche Publikationen aus den Fraunhofer-Instituten.
On the influence of input noise on a generalization error estimator
Artificial Intelligence and Applications : Proceedings of the IASTED International Conference on Artificial Intelligence and Applications (as part of the 22nd IASTED International Multi-Conference on Applied Informatics)
Anaheim: ACTA Press, 2004
|International Conference on Artificial Intelligence and Applications <2004>|
| Conference Paper|
|Fraunhofer FIRST ()|
Estimating the generalization capability is one of the most important problems in supervised learning. Therefore, various generalization error estimators have been proposed so far, in the presence of noise in output values. On the other hand, noise often exists in input values as well as output values. In this paper, we therefore investigate the influence of input noise on a generalization error estimator. We focus on a particular generalization error estimator called the subspace information criterion (SIC), which is shown to be unbiased in the absence of input noise. Intuitively, small input noise does not seem to affect the unbiasedness of SIC severely because small input noise varies the output values only slightly if the learning target function is continuous. On the contrary to this intuition, we show that even small input noise can totally corrupt the unbiasedness of SIC. This fact casts doubt on the use of SIC in the presence of input noise. To cope with this pr oblem,we provide a sufficient condition to guarantee that SIC is unbiased in the limit of small input noise. We finally show that this condition is always fulfilled when the standard ridge estimation is used for learning, which allows us to use SIC without concern even in the presence of small input noise.