Big Data Analysis and Security Consideration with Hadoop-based Cloud Platform

• Main Authors: Kuang-yuan Tung, 董光遠
• Other Authors: Jain-Shing Liu
• Format: Others
• Language: en_US
• Published: 2013
• Online Access: http://ndltd.ncl.edu.tw/handle/10317091983274976026

博士 === 國立中山大學 === 資訊工程學系研究所 === 101 === We use Hadoop to construct a trial cloud platform to tackle the challenges derived from the heavy traffic, and perform network traffic analysis and target packet dissection. Our testbed evaluates the performance against different processing strategies, and shows the statistic results. According to the experimental results, the Hadoop-based platform can fit to process massive traffic data very well, and it’s appropriate to manage today’s data centers with cloud computing services. We also try to construct a highly secure Hadoop platform with small deployment cost, robust attacking prevention, and less performance degradation. Simulation results reveal the feasibility of security mechanisms, and find that the more important thing to construct cloud platforms with appropriate security mechanisms is to consider the application requirements, which could be a better trade-off between security and user requirement.