A stream processing abstraction framework

• Published in: Frontiers in Big Data
• Main Authors: Ilaria Bartolini, Marco Patella
• Format: Article
• Language: English
• Published: Frontiers Media S.A. 2023-10-01
• Subjects: stream processing; real-time analysis; Big Data; multimedia data streams; software framework
• Online Access: https://www.frontiersin.org/articles/10.3389/fdata.2023.1227156/full

Real-time analysis of large multimedia streams is nowadays made efficient by the existence of several Big Data streaming platforms, like Apache Flink and Samza. However, the use of such platforms is difficult due to the fact that facilities they offer are often too raw to be effectively exploited by analysts. We describe the evolution of RAM3S, a software infrastructure for the integration of Big Data stream processing platforms, to SPAF, an abstraction framework able to provide programmers with a simple but powerful API to ease the development of stream processing applications. By using SPAF, the programmer can easily implement real-time complex analyses of massive streams on top of a distributed computing infrastructure, able to manage the volume and velocity of Big Data streams, thus effectively transforming data into value.