Fraunhofer-Institut für Intelligente Analyse- und Informationssysteme IAIS

Filters

3 2
3 2
Reset filters

Settings
Now showing 1 - 5 of 5
  • Publication
    On the effects of biased quantum random numbers on the initialization of artificial neural networks
    ( 2024-01-16)
    Heese, Raoul
    ;
    Wolter, Moritz
    ;
    Mücke, Sascha
    ;
    Franken, Lukas
    ;
    Piatkowski, Nico
    Recent advances in practical quantum computing have led to a variety of cloud-based quantum computing platforms that allow researchers to evaluate their algorithms on noisy intermediate-scale quantum devices. A common property of quantum computers is that they can exhibit instances of true randomness as opposed to pseudo-randomness obtained from classical systems. Investigating the effects of such true quantum randomness in the context of machine learning is appealing, and recent results vaguely suggest that benefits can indeed be achieved from the use of quantum random numbers. To shed some more light on this topic, we empirically study the effects of hardware-biased quantum random numbers on the initialization of artificial neural network weights in numerical experiments. We find no statistically significant difference in comparison with unbiased quantum random numbers as well as biased and unbiased random numbers from a classical pseudo-random number generator. The quantum random numbers for our experiments are obtained from real quantum hardware.
  • Publication
    Feature selection on quantum computers
    ( 2023-02-20)
    Mücke, Sascha
    ;
    Heese, Raoul
    ;
    Müller, Sabine
    ;
    Wolter, Moritz
    ;
    Piatkowski, Nico
    In machine learning, fewer features reduce model complexity. Carefully assessing the influence of each input feature on the model quality is therefore a crucial preprocessing step. We propose a novel feature selection algorithm based on a quadratic unconstrained binary optimization (QUBO) problem, which allows to select a specified number of features based on their importance and redundancy. In contrast to iterative or greedy methods, our direct approach yields higher-quality solutions. QUBO problems are particularly interesting because they can be solved on quantum hardware. To evaluate our proposed algorithm, we conduct a series of numerical experiments using a classical computer, a quantum gate computer, and a quantum annealer. Our evaluation compares our method to a range of standard methods on various benchmark data sets. We observe competitive performance.
  • Publication
    Informed Machine Learning - A Taxonomy and Survey of Integrating Prior Knowledge into Learning Systems
    ( 2023)
    Rueden, Laura von
    ;
    Mayer, Sebastian
    ;
    Beckh, Katharina
    ;
    Georgiev, Bogdan
    ;
    Giesselbach, Sven
    ;
    Heese, Raoul
    ;
    Kirsch, Birgit
    ;
    Walczak, Michal
    ;
    Pfrommer, Julius
    ;
    Pick, Annika
    ;
    Ramamurthy, Rajkumar
    ;
    Garcke, Jochen
    ;
    Bauckhage, Christian
    ;
    Schuecker, Jannis
    Despite its great success, machine learning can have its limits when dealing with insufficient training data. A potential solution is the additional integration of prior knowledge into the training process which leads to the notion of informed machine learning. In this paper, we present a structured overview of various approaches in this field. We provide a definition and propose a concept for informed machine learning which illustrates its building blocks and distinguishes it from conventional machine learning. We introduce a taxonomy that serves as a classification framework for informed machine learning approaches. It considers the source of knowledge, its representation, and its integration into the machine learning pipeline. Based on this taxonomy, we survey related research and describe how different knowledge representations such as algebraic equations, logic rules, or simulation results can be used in learning systems. This evaluation of numerous papers on the basis of our taxonomy uncovers key methods in the field of informed machine learning.
  • Publication
    Quantum Feature Selection
    ( 2022-03-24)
    Mücke, Sascha
    ;
    Heese, Raoul
    ;
    Müller, Sabine
    ;
    Wolter, Moritz
    ;
    Piatkowski, Nico
    In machine learning, fewer features reduce model complexity. Carefully assessing the influence of each input feature on the model quality is therefore a crucial preprocessing step. We propose a novel feature selection algorithm based on a quadratic unconstrained binary optimization (QUBO) problem, which allows to select a specified number of features based on their importance and redundancy. In contrast to iterative or greedy methods, our direct approach yields higher- quality solutions. QUBO problems are particularly interesting because they can be solved on quantum hardware. To evaluate our proposed algorithm, we conduct a series of numerical experiments using a classical computer, a quantum gate computer and a quantum annealer. Our evaluation compares our method to a range of standard methods on various benchmark datasets. We observe competitive performance.
  • Publication
    Informed Machine Learning - A Taxonomy and Survey of Integrating Knowledge into Learning Systems
    ( 2019-03-29)
    Rüden, Laura von
    ;
    Mayer, Sebastian
    ;
    Beckh, Katharina
    ;
    Georgiev, Bogdan
    ;
    Giesselbach, Sven
    ;
    Heese, Raoul
    ;
    Kirsch, Birgit
    ;
    Pfrommer, Julius
    ;
    Pick, Annika
    ;
    Ramamurthy, Rajkumar
    ;
    Schuecker, Jannis
    ;
    Garcke, Jochen
    ;
    Bauckhage, Christian
    ;
    Walczak, Michal
    Despite its great success, machine learning can have its limits when dealing with insufficient training data. A potential solution is the additional integration of prior knowledge into the training process, which leads to the notion of informed machine learning. In this paper, we present a structured overview of various approaches in this field. First, we provide a definition and propose a concept for informed machine learning, which illustrates its building blocks and distinguishes it from conventional machine learning. Second, we introduce a taxonomy that serves as a classification framework for informed machine learning approaches. It considers the source of knowledge, its representation, and its integration into the machine learning pipeline. Third, we survey related research and describe how different knowledge representations such as algebraic equations, logic rules, or simulation results can be used in learning systems. This evaluation of numerous papers on the basis of our taxonomy uncovers key methods in the field of informed machine learning.