A Framework of Distributed Snapshots for Hadoop HBase

• Main Authors: Chi-TsunLiao, 廖啟村
• Other Authors: Hung-Chang Hsiao
• Format: Others
• Language: en_US
• Published: 2013
• Online Access: http://ndltd.ncl.edu.tw/handle/5bwj3f

碩士 === 國立成功大學 === 資訊工程學系碩博士班 === 101 === Apache Hadoop HBase™ is an emerging distributed key-value persistent data store, which can accommodate a large volume of data rapidly introduced from a variety of sources. While data objects stored in HBase are precious, HBase is unable to perform parallel recovery for recovering historical data objects concurrently stored in multiple storage servers in a consistent manner. The study presents a framework for implementing a data recovery scheme in HBase. The framework consists of four components, including (1) distributed snapshots represented by event logs gathered from internal (system) and external (clients) operations, (2) a global time labeling scheme for correlated events, (3) a bulk load process for bootstrapping a HBase cluster with a given snapshot, and (4) a forward replaying mechanism for precisely running the system into any specified time instance in the past. We enhance HBase such that it is capable of performing parallel recovery, and demonstrate our prototype implementation with performance results. In addition, based on our prototype, an application tracking multiple clients’ locations is demonstrated.