Two-Step Classification with SVD Preprocessing of Distributed Massive Datasets in Apache Spark

Two-Step Classification with SVD Preprocessing of Distributed Massive Datasets in Apache Spark

At the dawn of the 10V or big data data era, there are a considerable number of sources such as smart phones, IoT devices, social media, smart city sensors, as well as the health care system, all of which constitute but a small portion of the data lakes feeding the entire big data ecosystem. This 10...

Full description

Bibliographic Details
Main Authors: Athanasios Alexopoulos, Georgios Drakopoulos, Andreas Kanavos, Phivos Mylonas, Gerasimos Vonitsanos
Format: Article
Language:English
Published: MDPI AG 2020-03-01
Series:Algorithms
Subjects:
apache spark
apache mllib
pyspark
big data
machine learning
10v data
two-step classification
ensemble classification
svd
sparkql
computing performance
f1 metric
dataframe
Online Access:https://www.mdpi.com/1999-4893/13/3/71

Internet

https://www.mdpi.com/1999-4893/13/3/71

Similar Items