Thumbnail Image
Item

Model Selection Using Graph Neural Networks

Nápoles,Gonzalo
; 
Grau,Isel
; 
Güven,Çiçek
; 
Salgueiro,Yamisleydi
Abstract
This paper tackles the problem of selecting the optimal models (algorithms and their hyperparameters) for a structured classification problem using Graph Neural Networks (GNNs). Recent efforts in this direction associate statistical meta-features describing the problem with the performance of predefined models. However, the predictive power of these meta-features is insufficient while being expensive to compute. The approach presented in this paper encodes each problem as a granular knowledge graph where nodes denote prototypes, while edges capture their distance. Moreover, nodes are labeled with the most popular class in their neighborhood, and their quality is quantified with a purity score. The adjacency-based representations of these knowledge graphs establish positive arrows between close prototypes that belong to different decision classes. Therefore, solving the multilabel model selection problem consists of predicting the set of optimal models for a given dataset represented by its adjacency-based matrix knowledge graph. The results indicate that the proposed GNN-based meta-classifier can predict an optimal model for 92% of the datasets, suppressing the need to extract low-level features.
Description
Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.
Date
2024
Journal Title
Journal ISSN
Volume Title
Publisher
Springer Science and Business Media Deutschland GmbH
Collections
Tilburg University Research Output Collection
Show all metadata
Files
Thumbnail Image
model_selection.pdf
Adobe PDF, 703.23 KB
Research Projects
Organizational Units
Journal Issue
Keywords
Graphical neural networks, Meta-classifier, Meta-features, Multilabel model selection problem
Citation
Nápoles, G, Grau, I, Güven, Ç & Salgueiro, Y 2024, Model Selection Using Graph Neural Networks. in K Arai (ed.), Intelligent Systems and Applications - Proceedings of the 2024 Intelligent Systems Conference IntelliSys Volume 2. Lecture Notes in Networks and Systems, vol. 1066 LNNS, Springer Science and Business Media Deutschland GmbH, pp. 332-347, Intelligent Systems Conference, IntelliSys 2024, Amsterdam, Netherlands, 5/09/24. https://doi.org/10.1007/978-3-031-66428-1_20
URI
https://hdl.handle.net/20.500.14602/25814
Embedded videos