Time Estimation and Resource Minimization Scheme for Apache Spark and Hadoop Big Data Systems With Failures

Time Estimation and Resource Minimization Scheme for Apache Spark and Hadoop Big Data Systems With Failures

Apache Spark and Hadoop are open source frameworks for big data processing, which have been adopted by many companies. In order to implement a reliable big data system that can satisfy processing target completion times, accurate resource provisioning and job execution time estimations are needed. I...

Full description

Bibliographic Details
Main Authors: Jinbae Lee, Bobae Kim, Jong-Moon Chung
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Big data
failure probability
Apache Spark
resilient distributed dataset (RDD)
Apache Hadoop
MapReduce
Online Access:https://ieeexplore.ieee.org/document/8605312/

Similar Items

Similar Items