Journey to a Big Data Analysis Platform: Are we there yet?

Data warehousing and analytics are going through a metamorphosis. Corporations are transforming their data warehousing capabilities, centralizing data analytics, and leveraging cloud technologies. Eight years ago, at ASMC 2013, we presented our approach to big data solutions and asked the industry leaders to help unify technologies to enable our big data transformations more seamlessly for the industry. This paper will cover what does, what did not, and what will not in the future work, where data and analytics are heading, and what the semiconductor industry needs to do to address big data challenges. The material will present clear reasons for leveraging big data solutions including up to 20× performance improvements analysis, cloud to cloud sharing options, ways to easily scale and handle data growth and centralizing information. There will also be a few areas where it will be shown how better integration from the factory floor to the modern data analysis platforms could be possible but cannot be fully addressed without the help from vendors.