Big Data Analytics: Analysis of Features and Performance of Big Data Ingestion Tools

• Main Authors: Andreea MATACUTA, Catalina POPA
• Format: Article
• Language: English
• Published: Inforec Association 2018-01-01
• Series: Informatică economică
• Subjects: Big Data; Data ingestion; Real-time processing; Performance Functionality; Data Ingestion Tools
• Online Access: http://revistaie.ase.ro/content/86/03%20-%20matacuta,%20popa.pdf

The purpose of this study was to analyze the features and performance of some of the most widely used big data ingestion tools. The analysis is made for three data ingestion tools, developed by Apache: Flume, Kafka and NiFi. The study is based on the information about tool functionalities and performance. This information was collected from different sources such as articles, books and forums, provided by people who really used these tools. The goal of this study is to compare the big data ingestion tools, in order to recommend that tool which satisfies best the specific needs. Based on the selected indicators, the results of the study reveal that all tools consistently assure good results in big data ingestion, but NiFi is the best option from the point of view of functionalities and Kafka, considering the performance.