Data analysis model for pipeline system and its application based on Big Data

Previously, analysis on the data of pipeline enterprise focused on the causality. However, in the Big Data Era, a series of information integrations, management procedures, detection records and routine operation and maintenance records of the pipeline system are linked up by data networks like internet of things (IOT) and cloud computing, making the data analysis gradually change from causality to non-causal relationship (relevance). In this paper, based on study on the Big Data analysis model, it is concluded that Big Data analysis will be one of the major trends of pipeline enterprise. Consequently, this paper builds a Big Data management architecture model suitable for the future pipeline system, proposes a Big Data based pipeline data algorithm model, and further improves the inline detection data management model. All these models were actually used for data analysis in the aspects like pipeline leakage and warning, pipeline geologic disaster, pipeline corrosion management and pipeline inline detection. Integrated and global analysis conclusions related to energy consumption control, hazard control and risk control have been obtained, showing the significances of Big Data in the development of pipeline industry.