Deep neural network to extract high-level features and labels in multi-label classification problems
Bello,Marilyn Nápoles,Gonzalo Sánchez,Ricardo Bello,Rafael Vanhoof,Koen
Bello,Marilyn
Nápoles,Gonzalo
Sánchez,Ricardo
Bello,Rafael
Vanhoof,Koen
Abstract
Pooling layers help reduce redundancy and the number of parameters in deep neural networks without the need of performing additional learning processes. Although these operators are able to deal with both single-label and multi-label problems they are specifically aimed at reducing feature space. However, in the case of multi-label data, this should also be done in the label space. On the other hand, in spite of their success, existing pooling operators are not ideal when handling (multi-label) datasets that do not have an explicit topological organization. In this paper, we present a deep neural architecture using bidirectional association-based pooling layers to extract high-level features and labels in multi-label classification problems. Our approach uses an association function to detect distinct pairs of neurons that will be aggregated into pooled neurons. In the first pooling layer, our proposal computes the Pearson correlation among the variables as the basis to quantify the association values. In addition, we propose an iterative procedure that allows estimating the association degree among pooled neurons in deeper layers without the need of recomputing the correlation matrix. The main advantage of this deep neural architecture is that it allows extracting high-level features and labels on datasets with no specific topological organization. The numerical results show that our bidirectional neural network helps reduce the number of problem features and labels while preserving network’s discriminatory power.
Description
Funding Information: The authors would like to thank the anonymous reviewers for their valuable and constructive feedback. Moreover, we would like to thank Isel Grau from the Vrije Universiteit Brussel (Belgium) and Leonardo Concepci?n from the Universiteit Hasselt (Belgium) for their comments. Publisher Copyright: © 2020 Elsevier B.V.
Date
2020-11-06
Journal Title
Journal ISSN
Volume Title
Publisher
Research Projects
Organizational Units
Journal Issue
Keywords
Deep neural networks, Multi-label classification, High-level features, High-level labels, Association-based pooling
Citation
Bello, M, Nápoles, G, Sánchez, R, Bello, R & Vanhoof, K 2020, 'Deep neural network to extract high-level features and labels in multi-label classification problems', Neurocomputing, vol. 413, pp. 259-270. https://doi.org/doi.org/10.1016/j.neucom.2020.06.117