Design and Application of Bank Big Data Platform Based on Hadoop Technology

At present, the design of big data platforms for many domestic banks is still insufficient. This article builds a Hadoop-based bank big data platform based on the big data platform construction experience of a large state-owned commercial bank. By introducing cutting-edge mainstream big data open-so...

Full description

Bibliographic Details
Main Authors: Dong Hao, Han Wenquan
Format: Article
Language:English
Published: EDP Sciences 2020-01-01
Series:E3S Web of Conferences
Online Access:https://www.e3s-conferences.org/articles/e3sconf/pdf/2020/74/e3sconf_ebldm2020_01028.pdf
Description
Summary:At present, the design of big data platforms for many domestic banks is still insufficient. This article builds a Hadoop-based bank big data platform based on the big data platform construction experience of a large state-owned commercial bank. By introducing cutting-edge mainstream big data open-source tools, the overall architecture of the big data platform of commercial banks is built. At the same time, this article discusses critical technical solutions such as storage engine, resource management, calculation engine, analysis engine, interactive front end, and data management, task management, and user management to build a bank’s big data platform. This article hopes to provide a reference for other banks to make big data platforms.
ISSN:2267-1242