The goal is to design sensor data fusion algorithms that can synergistically combine defect-related information from heterogeneous sensors used in gas pipeline inspection to reliably and accurately predict the condition of the pipe wall in an attempt to help maintain the nation’s natural gas transmission and distribution infrastructure through enhanced evaluation of pipeline inspection data. 

Rowan University – project management and research product

Location:
Glassboro, NJ 08028

Accurate and reliable characterization of the pipe wall condition in gas transmission pipelines requires inspection using more than one method of non-destructive testing. The objective of this research is to develop a suite of sensor data fusion algorithms that synergistically combine signals to obtain information that is not present in data from heterogeneous sensors (i.e. magnetic, ultrasonic, and thermal).

The multi-sensor data fusion algorithms are employed in two stages. In the first stage, data from multiple inspection modalities are fused to identify and separate pipe-wall anomalies from benign indications. A machine learning algorithm that is capable of incremental learning is employed for this purpose. In the second stage, the multi-sensor data is fused to predict the size and shape of those indications, identified as anomalies. Models that are based on human stereoscopic vision are used to design a data fusion processes in order to extract redundant and complementary information among different sets of sensors.

Data fusion techniques (Learn++ and Geometric transformations) were exercised on a test-specimen suite that was fabricated to exhibit common indications (both benign and anomalous) that occur in gas transmission pipelines. This test-specimen suite was subjected to multi-sensor interrogation using ultrasonic testing, magnetic flux leakage, and thermal imaging techniques.

The Learn++ algorithm’s data fusion capabilities were evaluated on the magnetic flux leakage (MFL) and ultrasonic testing (UT) data obtained from the test-specimen suite. Of particular interest was whether the generalization performance of the algorithm could be improved when data from two different non-destructive evaluation (NDE) modalities (i.e. magnetic flux leakage (MFL) and ultrasonic testing (UT) are fused. To test this performance, the test-specimen suite was partitioned into two sections, ten to be used for training the algorithm, and eleven to be used for validation. A total of five categories (namely pitting, crack, mechanical damage, weld, and no defect) were used for classification. The goal was to compare the classification performances when trained with only MFL or UT data to the performance when the data was combined through the Learn++ algorithm. The initial results were very promising.

In order to train the artificial neural network for defect characterization, it is necessary to indicate the desired complementary and redundant information between the two NDE inspection methods. Complementary information in two NDE images are defined as those distinct pixels in each of the NDE signatures that are present in the defect region, but are not shared between them. Redundant information in two NDE images is defined as those common pixels that are present in both NDE signatures and present in the defect region. The results of tests indicated that the proposed technique is able to successfully extract redundant and complementary information related to geometry of the defect. The best results are obtained for the fusion of UT and MFL data, and the poorest performance results combined thermal imaging and any other method. These results are consistent with the quality and amount of information contained in these respective modalities.  

Inspection and evaluation of natural gas pipeline condition is a critical element in assuring delivery reliability, safety and operational functionality of the nation’s energy infrastructure. Inspection is carried out using different non-destructive evaluation techniques that concentrate on different aspects of potential pipeline damage which can reduce safe and reliable operating pressure and / or life of the pipeline. This technology’s potential impact lies in its ability to take unique evaluation data from different sources and generate a more robust and reliable picture of the true condition of the infrastructure by using complementary data to confirm areas of concern and signal differences. This limits false alarms which would cause unnecessary excavations and repairs. By offering an opportunity to enhance the clarity of pipeline conditions, the project holds the potential to: 1) reduce lost product through leaks developed from unfound damage, 2) reduce emissions which could result from leaks and 3) increase the overall safety and reliability of the pipeline system by ensuring thorough evaluation of the available inspection data.

• Completed the development of a generalized technique for fusing data from multiple, heterogeneous non-destructive evaluation (NDE) interrogations of the same test specimen.
• Designed and developed a data fusion algorithm that can extract redundant and complementary defect-related information present in distinct NDE signals.
• Designed and developed a data fusion algorithm that incrementally learns to classify multi-sensor NDE signals.
• Validated the data fusion algorithms using laboratory-generated data that is representative of NDE signals obtained in gas transmission pipes.
• Fabricated a test specimen suite for performing NDE in the laboratory. The test specimens consisted of 0.5” thick SA-516-Gr. 70 steel coupons containing simulated cracks and 4” x 6” ASTM-836 steel specimens with simulated benign and anomalous indications.
• Designed and developed two versions of a test platform for performing multi-sensor NDE of test specimens under bi-axial load simulating the conditions inside a pressurized pipe.
• Obtained magnetic flux leakage (MFL), ultrasonic testing (UT), thermal imaging and acoustic emission (AE) data from test specimens.
• Designed and developed a neural-network based geometric transformation algorithm for extracting redundant and complementary information present among NDE signatures obtained using different inspection methods.
• Designed and developed an incremental machine learning algorithm for fusing data from multiple inspection modalities to identify and separate pipe-wall anomalies from benign indications.
• Results from this research activity were presented and published in the proceedings of the Natural Gas Technologies II Conference in Phoenix, February 2004 and formed the basis of Mr. Philip J. Kulick’s Master’s Thesis, published by Rowan University in December 2003.
• An immersive, interactive and navigable VR data fusion environment was defined and created, consisting of (a) graphical data, (b) measurement data, and (c) functional data. The framework was demonstrated using multi-sensor data obtained during the in-line inspection of a section of a gas transmission pipeline.
• Graphical models of the pipeline components were displayed in addition to MFL / UT inspection signals, neural network predictions of pipeline condition, and the geographic location of the pipeline network. The technique allows the inspection vendor to rapidly sift through hundreds of miles of pipeline inspection data and zero-in on features of interest and suggest appropriate remediation measures, if required.
• Virtual reality environments show considerable promise for the integration of multi-sensor data. The system allows a user to rapidly sift through large and complex data sets to isolate features of interest.
• Additionally, the VR environment has the ability to evolve as a function of both system data and user input. This use of data integration and evolution empowers the user to evaluate scenarios to make informed decisions.

The project is complete and the final report is listed below under "Additional Information".

$161,867

$54,000

NETL – Richard Baker (richard.baker@netl.doe.gov or 304-285-4714)
Rowan University – Shreekanth Mandayam (shreek@rowan.edu or 856-256-5333)

Final Report [PDF-2932KB]