Thumbnail Image
Item

Backpropagation through time learning for recurrence-aware long-term cognitive networks

Napoles,Gonzalo
; 
Jastrzebska,Agnieszka
; 
Grau,Isel
; 
Salgueiro,Yamisleydi
Abstract
Fuzzy Cognitive Mapping (FCM) and the extensive family of models derived from it have firmly established their strong position in the landscape of machine learning algorithms. Specifically designed for pattern classification and multi -output regression, the recently introduced Recurrence -aware Long-term Cognitive Network (r-LTCN) model is one of these FCM-inspired extensions. On the one hand, this recurrent neural network connects all temporal states generated during the reasoning process with the decision -making layer. On the other hand, it uses a quasi -nonlinear reasoning rule devoted to avoiding convergence issues caused by unique fixed points, which typically emerge in other FCM models. In the original paper, the authors employed a combination of unsupervised and supervised learning to compute the r-LTCNs' learnable parameters. Despite r-LTCNs' astounding performance for a wide variety of pattern classification problems, the literature reports no attempt to train these recurrent neural systems in a fully supervised manner nor provide insights into their performance in other machine learning settings. This paper brings forward a modified Backpropagation Through Time learning (BPTT) algorithm devoted to training r-LTCN models used for multi -output regressions tasks rather than pattern classification. The proposed BPPT includes a simple yet effective mechanism to deal with the vanishing gradient within the recurrent layer that operates as a closed system while being tailored to the quasi -nonlinear reasoning mechanism. Empirical evaluation of the proposed BPTT algorithm using 20 multioutput regression problems reveals that it produces lower prediction errors compared with other state-of-the-art learning approaches.
Description
Publisher Copyright: © 2024 The Author(s)
Date
2024-07-08
Journal Title
Journal ISSN
Volume Title
Publisher
Collections
Tilburg University Research Output Collection
Show all metadata
Files
Thumbnail Image
backpropagation.pdf
Adobe PDF, 1.13 MB
Research Projects
Organizational Units
Journal Issue
Keywords
Backpropagation through time, Fuzzy cognitive maps, Recurrence-aware long-term cognitive network
Citation
Napoles, G, Jastrzebska, A, Grau, I & Salgueiro, Y 2024, 'Backpropagation through time learning for recurrence-aware long-term cognitive networks', Knowledge-Based Systems, vol. 295, 111825. https://doi.org/10.1016/j.knosys.2024.111825
URI
https://hdl.handle.net/20.500.14602/81447
Embedded videos