Data Product Metadata Management: An Industrial Perspective
Driessen,Stefan Monsieur,Geert van den Heuvel,Willem Jan
Driessen,Stefan
Monsieur,Geert
van den Heuvel,Willem Jan
Abstract
Decentralised data exchanges are promising alternatives to monolithic data lakes and warehouses which are typically emerging around complex service solutions. In theory, this removes some of the bottlenecks of traditional data management solutions. In practice, the road towards achieving such goal is a long way ahead. In this work, we provide an industry perspective on the implications for such work, with a focus on metadata management; the work in question draws from an in-vivo action research approach we enacted at a major German automotive company that is transitioning to an internal decentral data market. Our results provide insight into an industry perspective on the requirements for metadata management. Additionally, we propose and validate a solution design for metadata management in decentralised data exchanges based on semantic web service technology.
Description
Publisher Copyright: © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.
Date
2023
Journal Title
Journal ISSN
Volume Title
Publisher
Springer Science and Business Media Deutschland GmbH
Research Projects
Organizational Units
Journal Issue
Keywords
Data market, Data mesh, Data product, Metadata, Semantic web
Citation
Driessen, S, Monsieur, G & van den Heuvel, W J 2023, Data Product Metadata Management : An Industrial Perspective. in J Troya, R Mirandola, E Navarro, A Delgado, S Segura, P Fernández, G Ortiz, C Pautasso, C Zirpins & A Ruiz-Cortés (eds), Service-Oriented Computing – ICSOC 2022 Workshops - ASOCA, AI-PA, FMCIoT, WESOACS 2022, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13821 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 237-248, Workshops on ASOCA, AI-PA, FMCIoT, WESOACS 2022, held in Conjunction with the 20th International Conference on Service-Oriented Computing, ICSOC 2022, Seville, Spain, 29/11/22. https://doi.org/10.1007/978-3-031-26507-5_19