Big Data Pipelines on the Computing Continuum: Tapping the Dark Data
Roman, Dumitru; Prodan, Radu; Nikolov, Nikolay; Soylu, Ahmet; Matskin, Mihhail; Marrella, Andrea; Kimovski, Dragi; Elvesæter, Brian; Simonet-Boulogne, Anthony; Ledakis, Giannis; Song, Hui; Leotta, Francesco; Kharlamov, Evgeny
Peer reviewed, Journal article
Accepted version
Permanent lenke
https://hdl.handle.net/11250/3048498Utgivelsesdato
2022-10-25Metadata
Vis full innførselSamlinger
Sammendrag
Big Data pipelines are essential for leveraging Dark Data, i.e., data collected but not used and turned into value. However, tapping their potential requires going beyond existing approaches and frameworks for Big Data processing. The Computing Continuum enables new opportunities for managing Big Data pipelines concerning efficient management of heterogeneous and untrustworthy resources. This article discusses the Big Data pipelines lifecycle on the Computing Continuum, its associated challenges and outlines a future research agenda in this area.