• English
  • Deutsch
  • Log In
    Password Login
    Research Outputs
    Fundings & Projects
    Researchers
    Institutes
    Statistics
Repository logo
Fraunhofer-Gesellschaft
  1. Home
  2. Fraunhofer-Gesellschaft
  3. Scopus
  4. Improving the Predictive Power of Historical Consistent Neural Networks
 
  • Details
  • Full
Options
2022
Journal Article
Title

Improving the Predictive Power of Historical Consistent Neural Networks

Abstract
The Historical Consistent Neural Networks (HCNN) are an extension of the standard Recurrent Neural Networks (RNN): they allow the modeling of highly-interacting dynamical systems across multiple time scales. HCNN do not draw any distinction between inputs and outputs, but model observables embedded in the dynamics of a large state space. In this paper, we propose to improve the predictive power of the (Vanilla) HCNN using three methods: (1) HCNN with Partial Teacher Forcing, (2) HCNN with Sparse State Transition Matrix, and (3) a Long Short Term Memory Formulation of HCNN. We investigated the effect of those long memory improvement methods on three chaotic time-series mathematically generated from the Rabinovich–Fabrikant, the Rossler System and the Lorenz system. To complement our study, we compared the accuracy of the different HCNN variants with well-known recurrent neural networks methods such as Vanilla RNN and LSTM for the same prediction tasks. Overall, our results show that the Vanilla HCNN is superior to RNN and LSTM. This is even more the case if you include the above long memory extensions (1), (2) and (3). We demonstrate that (1) and (3) are superior for the modeling of our chaotic dynamical systems. We show that for these deterministic systems, the ensembles are narrowed.
Author(s)
Rockefeller, Rockefeller
Bah, Bubacarr
Marivate, Vukosi
Zimmermann, Hans Georg
Fraunhofer-Institut für Integrierte Schaltungen IIS  
Journal
Engineering proceedings  
Conference
International Conference on Time Series and Forecasting 2022  
Open Access
DOI
10.3390/engproc2022018036
Additional full text version
Landing Page
Language
English
Fraunhofer-Institut für Integrierte Schaltungen IIS  
Keyword(s)
  • chaotic dynamical systems

  • historical consistent neural networks

  • recurrent neural networks

  • time series forecasting

  • Cookie settings
  • Imprint
  • Privacy policy
  • Api
  • Contact
© 2024