Industrial big data refers to a large amount of diversified time series generated at a high speed by industrial equipment,[1] known as the Internet of things. The term emerged in 2012 along with the concept of "Industry 4.0”, and refers to big data”, popular in information technology marketing, in that data created by industrial equipment might hold more potential business value.[2] Industrial big data takes advantage of industrial Internet technology. It uses raw data to support management decision making, so to reduce costs in maintenance and improve customer service.[3] Please see intelligent maintenance system for more reference.
Big data refers to data generated in high volume, high variety, and high velocity that require new technologies of processing to enable better decision making, knowledge discovery and process optimization.[4] Sometimes, the feature of veracity is also added to emphasize the quality and integrity of the data.[5] However, for industrial big data, there should be two more "V’s". One is visibility, which refers to the discovery of unexpected insights of the existing assets and/or processes and in this way transferring invisible knowledge to visible value. The other "V" is value.
As data from automated industrial equipment are being generated at an extraordinary speed and volume, the infrastructure of storing and managing these data becomes the first challenge any industry will face. Different from the tradition business intelligence which mostly focuses on internal structured data and processes that information in regularly occurring cycles,[6] "Industrial Big Data” analytical system requires near real-time analytics and visualization of the results.
The first step is to collect the right data.[7] Since the automation level of modern equipment is getting higher, data are being generated from an increasing number of sensors. Recognizing the parameters are related to equipment status is important to reducing the amount of data necessary to be collected and increase the efficiency and effectiveness of data analytics.
The next step is to build a data management system that will be able to handle large amounts of data and perform analytics in near real-time. In order to enable rapid decision making, data storage, management and processing need to be more integrated.[7] General Electric has built a prototype data storage infrastructure for fleet of gas turbines.[8] The developed in-memory data grids (IMDG)-based system was proved to be able to handle challenging high velocity and high volume data flow while performing near real-time analytics on the data. They believe that the developed technology has demonstrated a viable path to realize batch "Industrial Big Data” management infrastructure. As prices of memory becomes cheaper, such systems will become central and fundamental to future industry.
Cyber-physical systems is the core technology of industrial big data. Cyber-physical systems are systems that require seamless integration between computational models and physical components.[9] Differing from the traditional operation technology, "Industrial Big Data” requires that the decision to be informed from a way wider scope, a central part of which is equipment status. T Improved processes will further increase productivity and reduce costs. This aligns with the mission of "Industrial Big Data”, which is to reveal insights from the large amount of raw data and turn that information into value. This combines the power of information technology and operation technology to create an information-transparent environment to support decisions for users of different levels.
Every unit in an industrial system generates vast amount of data every moment. Billions of data samples are being generated by every single machine per day in a manufacturing line.[1] As an example, a Boeing 787 generates over half a terabyte of data per flight.[10] Clearly the volume of data generated by group of units in an industrial system is far beyond the capability of traditional methods therefore handling, managing and processing it would be a challenge.
In the course of last several years, researchers and companies have actively participated in collecting, organizing and analyzing huge industrial data sets. Some of these data sets are currently available for public usage for research purposes.
NASA data repository[11] is one of the most famous data repositories for Industrial Big Data. Various data sets provided by this repository may be used for predictive analysis, fault detection, prognostics, etc.
| ID | Repository Name | Description of the Data | |
|---|---|---|---|
| 1 | Algae Raceway Data Set | 3 small raceways experiment for algae biomass | |
| 2 | CFRP Composites Data Set | Run-to-failure experiment on CFRP panels | |
| 3 | Milling Data Set | Experiments on a milling machine for different speeds, feeds, and depth of cut. Records the wear of the milling insert, VB. The data set was provided by the BEST lab at UC Berkeley.[12] | |
| 4 | Bearing Data Set | Experiments on bearings. The data set was provided by the Center for Intelligent Maintenance Systems (IMS), University of Cincinnati.[13] | |
| 5 | Battery Data Set | Experiments on Li-ion batteries. Charging and discharging at different temperatures. Records the impedance as the damage criterion. The data set was provided by the Prognostics CoE at NASA Ames. | |
| 6 | Turbofan Engine Degradation Simulation Data Set | Engine degradation simulation was carried out using C-MAPSS. Four different were sets simulated under different combinations of operational conditions and fault modes. Records several sensor channels to characterize fault evolution. The data set was provided by the Prognostics CoE at NASA Ames. | |
| 7 | IGBT Accelerated Aging Sata Set | Preliminary data from thermal overstress accelerated aging using the aging and characterization system. The data set contains aging data from 6 devices, one device aged with DC gate bias and the rest aged with a squared signal gate bias. Several variables are recorded and in some cases, high-speed measurements of gate voltage, collector-emitter voltage and collector current are available. The data set is provided by the Prognostics CoE at NASA Ames. | |
| 8 | Trebuchet Data Set | Trajectories of different types of balls launched from a trebuchet with varying counter weights. Flights were filmed and extraction routines calculated position of data. Both raw video data and extracted trajectories are provided. Geometry and physical properties of the trebuchet are available. | |
| 9 | FEMTO Bearing Data Set | Experiments on bearings' accelerated life tests provided by FEMTO-ST Institute, Besançon, France.[14] | |
| 10 | Randomized Battery Usage Data Set | Batteries are continuously cycled with randomly generated current profiles. Reference charging and discharging cycles are also performed after a fixed interval of randomized usage in order to provide reference benchmarks for battery state of health. | |
| 11 | Capacitor Electrical Stress Data Set | Capacitors were subjected to electrical stress under three voltage levels i.e. 10V, 12V and 14V. Data Set contains EIS data as well as Charge/Discharge Signal data. |
Leveraging machine learning and predictive analytics algorithms, industrial big data can help to create value in various use case scenarios like predictive maintenance (predicting and preventing machine failures or component failures, e.g. im manufacturing machines, airplanes, automotive vehicles, trains, wind turbine, oil pipelines, etc.), product quality prediction in early stages of the production process and product quality optimization (e.g. in the steel industry), prediction and prevention of critical situation in continuous production processes (e.g. in the chemical industry), prediction of product lifetime(e.g. car engines, wind turbine components, batteries, etc.), assembly plan prediction for new 3D product designs (e.g. for truck engine components, whitegoods like washers and dryers, etc.), energy demand prediction, demand forecasting, price forecasting, and many other use cases(see e.g. Industrial Data Science Conference (IDS 2017 and IDS 2019[15]).