Efficient processing and classification of wave energy spectrum data with a distributed pipeline
Processing of large amounts of data often consists of several steps, e.g. pre- and post-processing stages, which are executed sequentially with data written to disk after each step, however, when pre-processing stage for each task is different the more efficient way of processing data is to construc...
Main Authors: | I. G. Gankevich, A. B. Degtyarev |
---|---|
Format: | Article |
Language: | Russian |
Published: |
Institute of Computer Science
2015-06-01
|
Series: | Компьютерные исследования и моделирование |
Subjects: | |
Online Access: | http://crm.ics.org.ru/uploads/crmissues/crm_2015_3/15718.pdf |
Similar Items
-
Distributed ATrie Group Join: Towards Zero Network Cost
by: Prajwol Sangat, et al.
Published: (2020-01-01) -
Strategies and Principles of Distributed Machine Learning on Big Data
by: Eric P. Xing, et al.
Published: (2016-06-01) -
Pipeline-Based Linear Scheduling of Big Data Streams in the Cloud
by: Nicoleta Tantalaki, et al.
Published: (2020-01-01) -
Improvement of Parallelism Process in Distributed Data Processing
by: Roman Ceresnak, et al.
Published: (2021-01-01) -
FTLADS: Object-Logging Based Fault-Tolerant Big Data Transfer System Using Layout Aware Data Scheduling
by: Preethika Kasu, et al.
Published: (2019-01-01)