Load prediction based elastic resource scheduling strategy in Flink

Show other versions (1)

In order to solve the problem that the load of big data stream computing platform fluctuates drastically while the cluster was suffering from the performance bottleneck due to the shortage of computing resources,the load prediction based elastic resource scheduling strategy in Flink (LPERS-Flink) wa...

Full description

Bibliographic Details
Published in:	Tongxin xuebao
Main Authors:	Ziyang LI, Jiong YU, Yuefei WANG, Chen BIAN, Yonglin PU, Yitian ZHANG, Yu LIU
Format:	Article
Language:	Chinese
Published:	Editorial Department of Journal on Communications 2020-10-01
Subjects:	stream computing resource scheduling load prediction performance bottleneck Flink
Online Access:	http://www.joconline.com.cn/zh/article/doi/10.11959/j.issn.1000-436x.2020195/

Similar Items

Load prediction based elastic resource scheduling strategy in Flink
by: Ziyang LI, et al.
Published: (2020-10-01)

Flow-network based auto rescale strategy for Flink
by: Ziyang LI, et al.
Published: (2019-08-01)

Flow-network based auto rescale strategy for Flink
by: Ziyang LI, et al.
Published: (2019-08-01)

Node Priority Scheduling Strategy Based on Heterogeneous Flink Cluster
by: WANG Wenhao, SHI Xuerong
Published: (2022-03-01)

Integration of Multi-Source Landslide Disaster Data Based on Flink Framework and APSO Load Balancing Task Scheduling
by: Zongmin Wang, et al.
Published: (2024-12-01)

Machine learning in big data: A performance benchmarking study of Flink-ML and Spark MLlib
by: Messaoud MEZATI, et al.
Published: (2025-06-01)

SPARQL2Flink: Evaluation of SPARQL Queries on Apache Flink
by: Oscar Ceballos, et al.
Published: (2021-07-01)

DPASF: a flink library for streaming data preprocessing
by: Alejandro Alcalde-Barros, et al.
Published: (2019-06-01)

Apache Flink and clustering-based framework for fast anonymization of IoT stream data
by: Alireza Sadeghi-Nasab, et al.
Published: (2023-11-01)

GeoFlink: An Efficient and Scalable Spatial Data Stream Management System
by: Salman Ahmed Shaikh, et al.
Published: (2022-01-01)

Analiza porównawcza możliwości i ograniczeń wykorzystania silników Apache Flink, Apache Spark oraz Apache Storm w strumieniowym przetwarzaniu danych
by: Tomasz Waksmundzki, et al.
Published: (2024-12-01)

Energy-efficient optimization strategy based on elastic data migration in big data streaming platform
by: Yonglin PU, et al.
Published: (2024-02-01)

Energy-efficient optimization strategy based on elastic data migration in big data streaming platform
by: Yonglin PU, et al.
Published: (2024-02-01)

Scheduling algorithm for stochastic job stream cipher service based on load balancing
by: Li LI, et al.
Published: (2018-06-01)

Scheduling algorithm for stochastic job stream cipher service based on load balancing
by: Li LI, et al.
Published: (2018-06-01)

WORKFLOW SCHEDULING ACCORDING TO DATA DEPENDENCIES IN COMPUTATIONAL CLOUDS
by: Batoul Khazaie, et al.
Published: (2021-12-01)

A load-source coordinated scheduling method based on resource flexibility of load aggregators
by: ZHU Dandan, et al.
Published: (2024-04-01)

Value Stream Mapping for Evaluation of Load Scheduling Possibilities in a District Heating Plant
by: Raivo Melsas, et al.
Published: (2016-09-01)

Survey of streaming processing field
by: R. S. Samarev
Published: (2018-10-01)

DE-RALBA: dynamic enhanced resource aware load balancing algorithm for cloud computing
by: Altaf Hussain, et al.
Published: (2025-03-01)

Dynamic Scheduling and Collaborative Allocation System for Distributed Resource Based on YARN
by: HAO Zhifeng, HUANG Zelin, CAI Ruichu, FU Zhengjia, WEN Wen, TANG Kailin
Published: (2021-02-01)

WG-Storm: a resource-aware scheduler for distributed stream processing engines
by: Rizwan Ali, et al.
Published: (2025-04-01)

Virtual power plant load aggregation optimization scheduling strategy for port adjustable resources
by: Yun Zhang, et al.
Published: (2025-09-01)

Fast frequency response constrained stochastic scheduling of flexible loads in low inertia grids
by: Ashish Mathur, et al.
Published: (2024-12-01)

Integrating Schedule Risk Analysis with Multi-Skilled Resource Scheduling to Improve Resource-Constrained Project Scheduling Problems
by: Muritala Adebayo Isah, et al.
Published: (2021-01-01)

A NOVEL TRUE REAL-TIME SPATIOTEMPORAL DATA STREAM PROCESSING FRAMEWORK
by: ATURE ANGBERA, et al.
Published: (2022-09-01)

Dynamic Task Scheduling Scheme for Processing Real-Time Stream Data in Storm Environments
by: Dojin Choi, et al.
Published: (2021-08-01)

Towards a Task and Resource Aware Task Scheduling in Cloud Computing: An Experimental Comparative Evaluation
by: Muhammad Ibrahim, et al.
Published: (2020-05-01)

A Dynamic Adjusted Aggregate Load Method to Support Workload Control Policies
by: Paolo Renna
Published: (2020-05-01)

Optimal Renewable Resource Allocation and Load Scheduling of Resilient Communities
by: Jing Wang, et al.
Published: (2020-10-01)

Resource Scheduling in Edge Computing: Architecture, Taxonomy, Open Issues and Future Research Directions
by: Mostafa Raeisi-Varzaneh, et al.
Published: (2023-01-01)

Adaptive LOB scheduling for optimizing resource leveling and consumption
by: Ayman Altuwaim, et al.
Published: (2024-03-01)

Design and Implementation of Fine-Grained Scheduling Strategy for Kubernetes Heterogeneous Resources
by: LIU Zhibin, HUANG Qiulan, HU Qingbao, CHENG Yaodong, HU Yu, TIAN Haolai
Published: (2023-02-01)

An Improved Cuckoo Search Algorithm under Bottleneck-Degree-Based Search Guidance for Large-Scale Inter-Cell Scheduling Optimization
by: Peixuan Yang, et al.
Published: (2024-01-01)

Analysis of resource bottleneck in 4G network
by: Yuezhen WANG, et al.
Published: (2017-05-01)

Analysis of resource bottleneck in 4G network
by: Yuezhen WANG, et al.
Published: (2017-05-01)

Spatiotemporal Aspects of Big Data
by: Karim Saadia, et al.
Published: (2018-12-01)

Congestion behavior and tolling strategies in a bottleneck model with exponential scheduling preference
by: Chuanyao Li, et al.
Published: (2023-01-01)

A Distance-Based Scheduling Algorithm With a Proactive Bottleneck Removal Mechanism for Wireless Rechargeable Sensor Networks
by: Rei-Heng Cheng, et al.
Published: (2020-01-01)

Scheduling Elastic Machine Learning Process Through Containers
by: Leandro Ariel Libutti
Published: (2023-10-01)