A Transparent Big Data Storage Facility (Demo Abstract)

We present an infrastructural, big data storage facility for Taiwan’s semiconductor manufacturing industry. The service, named transparent data storage (TDS), has been built for operating in production systems. It evolves over time by incrementally accommodating users’ requirements, and tailors to Taiwan’s semiconductor manufacturing industry such as wafer fabrication foundry and IC packaging/test. Specifically, TDS is a RESTful, distributed big data storage facility. Users simply rely on TDS to access data objects stored in Hadoop with RESTful APIs. In addition, TDS is scalable and reliable. Moreover, TDS is efficient and effective by intelligently selecting either Hadoop distributed file system (HDFS) or database (HBase) for publishing data objects. This demo paper demonstrates the design and implementation features for TDS.