Big Data Pipelines on the Computing Continuum: Ecosystem and Use Cases Overview
Roman, Dumitru; Nikolov, Nikolay; Soylu, Ahmet; Elvesæter, Brian; Song, Hui; Prodan, Radu; Kimovski, Dragi; Marrella, Andrea; Leotta, Francesco; Matskin, Mihhail; Ledakis, Giannis; Theodosiou, Konstantinos; Simonet-Boulogne, Anthony; Perales, Fernando; Kharlamov, Evgeny; Ulisses, Alexandre; Solberg, Arnor; Ceccarelli, Raffaele
Peer reviewed, Journal article
Accepted version
![Thumbnail](/oda-xmlui/bitstream/handle/11250/2986343/DataCloud_DistInSys2021.pdf.jpg?sequence=6&isAllowed=y)
View/ Open
Date
2021-12-15Metadata
Show full item recordCollections
Original version
https://doi.org/10.1109/ISCC53001.2021.9631410Abstract
Organisations possess and continuously generate huge amounts of static and stream data, especially with the proliferation of Internet of Things technologies. Collected but unused data, i.e., Dark Data, mean loss in value creation potential. In this respect, the concept of Computing Continuum extends the traditional more centralised Cloud Computing paradigm with Fog and Edge Computing in order to ensure low latency pre-processing and filtering close to the data sources. However, there are still major challenges to be addressed, in particular related to management of various phases of Big Data processing on the Computing Continuum. In this paper, we set forth an ecosystem for Big Data pipelines in the Computing Continuum and introduce five relevant real-life example use cases in the context of the proposed ecosystem.