Big data management framework and its application in long-distance oil/gas pipeline

With continuous expansion of oil/gas pipelines and increasingly stringent pipeline safety evaluation in China, it is inevitable to use big data technique to process and analyze massive data generated in the process of pipeline design, construction and operation. Based on the requirements of pipeline safety evaluation in China, this paper presents the problems in the data management of pipeline in the country and proposes the preliminary framework of big data management of pipelines. The framework incorporates: (1) reasonable and accurate baseline for big data; (2) unified data recording and storage mode; (3) comprehensive acquisition of relevant data of pipeline; (4) basic rules and model for big data management, and integrated data management platform; and (5) analysis and decision procedures based on big data. Besides, processing flow of related data and application example are given, which can provide some reference for the application of big data in the safety management of long-distance oil/gas pipelines.