Experiences on Building a Big Data Platform for Real Applications: The Case of ANSYS Simulations

• Main Authors: Hao-JunChen, 陳浩駿
• Other Authors: Hung-Chang Hsiao
• Format: Others
• Language: en_US
• Published: 2016
• Online Access: http://ndltd.ncl.edu.tw/handle/17039845370536506566

碩士 === 國立成功大學 === 資訊工程學系 === 104 === Because of collaborative public manner, open source software has attracted many developers around the world to make contributions to their interested open source community. Few most famous open source software among them are Hadoop, HBase and Spark, raising great attention among industries. However, there are still many close source software that those don’t share their source code and always are used for business. Thus, if users want to upgrade software or maintain them, they have to pay service provider huge price for those services. In the meantime, close source software blocks developer from secondary developing. In Taiwan, Industrial Technology Research Institute (ITRI) is the lead of enterprises. As a technical service provider, ITRI has brought many software and their respective licenses. Then it rents out these licenses and execution environment to provide computing services to enterprises by using virtualization technology and setting up server cluster. This move greatly reduce the cost for enterprises, especially those small and medium size enterprises (SMEs). However, issue raises that how to make full use of the resources available among the server machines. So far, ITRI had successfully solved the resources requirements for computation by Message Passing Interface (MPI) technique. And as technical support team of ITRI, we choose to survey resource requirements for i/o operation, and aim to discover the i/o pattern or i/o feature by analysis. The outcomes of this thesis will be an application with a set of tools, including analysis and features visualization. We hope to help ITRI find the best way to make improvement on i/o performance as well as make best use of cluster’s resources.