Loading [MathJax]/extensions/MathMenu.js
Real-Time 3D Profiling with RGB-D Mapping in Pipelines Using Stereo Camera Vision and Structured IR Laser Ring | IEEE Conference Publication | IEEE Xplore

Real-Time 3D Profiling with RGB-D Mapping in Pipelines Using Stereo Camera Vision and Structured IR Laser Ring


Abstract:

This paper is focused on delivering a solution that can scan and reconstruct the 3D profile of a pipeline in realtime using a crawler robot. A structured infrared (IR) la...Show More

Abstract:

This paper is focused on delivering a solution that can scan and reconstruct the 3D profile of a pipeline in realtime using a crawler robot. A structured infrared (IR) laser ring projector and a stereo camera system are used to generate the 3D profile of the pipe as the robot moves inside the pipe. The proposed stereo system does not require field calibrations and it is not affected by the lateral movement of the robot, hence capable of producing an accurate 3D map. The wavelength of the IR light source is chosen to be non overlapping with the visible spectrum of the color camera. Hence RGB color values of the depth can be obtained by projecting the 3D map into the color image frame. The proposed system is implemented in Robotic Operating System (ROS) producing real-time RGB-D maps with defects. The defect map exploit differences in ovality enabling real-time identification of structural defects such as surface corrosion in pipe infrastructure. The lab experiments showed the proposed laser profiling system can detect ovality changes of the pipe with millimeter level of accuracy and resolution.
Date of Conference: 19-21 June 2019
Date Added to IEEE Xplore: 16 September 2019
ISBN Information:

ISSN Information:

Conference Location: Xi'an, China
References is not available for this document.

I. Introduction

Underground infrastructure such as sewage pipes and water pipes undergo severe concrete [1] and metallic [2] corrosion, which considerably reduces their service life. Monitoring such degradation through predictive modeling requires reliable sensor data for high-quality predictions [3]–[6]. However, in hostile sewer pipelines, sensors can malfunction over time [7]. In addition to monitoring physical changes of pipes, there are requirements to monitor the sensor health conditions themselves [8]. Therefore, water utilities around the world are experiencing an uphill battle for maintaining underground assets in a good condition to avoid catastrophic failures such as pipe bursts and ground collapses [9]. Further, human entry to smaller sized pipelines for visual inspections is not possible due to occupational health and safety risks. Traditionally, CCTV cameras are mounted on remotely operated robotic platforms for inspecting such pipelines, however they only provide visual cues that has limited structural information for decision making.

Select All
1.
K. Thiyagarajan, S. Kodagoda, R. Ranasinghe, D. Vitanage and G. Iori, Robust sensing suite for measuring temporal dynamics of surface temperature in sewers, vol. 8, no. 1, 2018.
2.
J. Valls Miro, N. Ulapane, L. Shi, D. Hunt and M. Behrens, "Robotic pipeline wall thickness evaluation for dense nondestructive testing inspection", Journal of Field Robotics, vol. 35, no. 8, pp. 1293-1310, 2018.
3.
K. Thiyagarajan, Robust Sensor Technologies Combined with Smart Predictive Analytics for Hostile Sewer Infrastructures, 2018.
4.
K. Thiyagarajan, S. Kodagoda, L. V. Nguyen and S. Wickramanayake, "Gaussian Markov Random Fields for Localizing Reinforcing Bars in Concrete Infrastructure", 2018 Proceedings of the 35th International Symposium on Automation and Robotics in Construction, pp. 1052-1058, 2018.
5.
K. Thiyagarajan, S. Kodagoda and N. Ulapane, "Data-driven machine learning approach for predicting volumetric moisture content of concrete using resistance sensor measurements", 2016 IEEE 11 th Conference on Industrial Electronics and Applications, pp. 1288-1293, 2016.
6.
B. Li, X. Fan, J. Zhang, Y. Wang, F. Chen, S. Kodagoda, et al., "Predictive Analytics Toolkit for H2S Estimation and Sewer Corrosion" in OZWater, Sydney:Australian Water Association, 2017.
7.
K. Thiyagarajan, S. Kodagoda, L. V. Nguyen and R. Ranasinghe, "Sensor Failure Detection and Faulty Data Accommodation Approach for Instrumented Wastewater Infrastructures", IEEE Access, vol. 6, pp. 56562-56574, 2018.
8.
K. Thiyagarajan, S. Kodagoda and L. V. Nguyen, "Predictive analytics for detecting sensor failure using autoregressive integrated moving average model", 2017 12th IEEE Conference on Industrial Electronics and Applications (ICIEA), pp. 1926-1931, 2017.
9.
K. Thiyagarajan, S. Kodagoda and J. K. Alvarez, "An instrumentation system for smart monitoring of surface temperature", 2016 14th International Conference on Control Automation Robotics and Vision (ICARCV), pp. 1-6, 2016.
10.
Z. Liu and D. Krys, "The use of laser range finder on a robotic platform for pipe inspection", Mechanical Systems and Signal Processing, vol. 31, pp. 246-257, 2012.
11.
J. Saenz, N. Elkmann, T. Stuerze, S. Kutzner and H. Althoff, "Robotic systems for cleaning and inspection of large concrete pipes", 2010 1st International Conference on Applied Robotics for the Power Industry CARPI 2010 Fraunhofer IFF, 2010.
12.
O. Duran, K. Althoefer and L. D. Seneviratne, "Automated pipe defect detection and categorization using caniera/laser-based profiler and artificial neural network", IEEE Transactions on Automation Science and Engineering, vol. 4, no. 1, pp. 118-126, 2007.
13.
J.-S. Yoon, M. Sagong, J. S. Lee and K.-s. Lee, "Feature extraction of a concrete tunnel liner from 3D laser scanning data", NDT and E International, vol. 42, no. 2, pp. 97-105, 2009.
14.
M. Nasrollahi, N. Bolourian, Z. Zhu and A. Hammad, "Designing LiDAR-equipped UAV platform for structural inspection", 35th International Symposium on Automation and Robotics in Construction and International AEC/FM Hackathon: The Future of Building Things ISARC 2018. Department of Building Civil and Environmental Engineer Concordia University, 2018.
15.
E. Ujkani, J. Dybedal, A. Aalerud, K. B. Kaldestad and G. Hovland, "Visual Marker Guided Point Cloud Registration in a Large Multi-Sensor Industrial Robot Cell", 14th IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications MESA 2018. Department of Engineering Sciences Mechatronics Group University of Agder, 2018.
16.
N. Stanić, M. Lepot, M. Catieau, J. Langeveld and F. Clemens, "A technology for sewer pipe inspection (part 1): Design calibration corrections and potential application of a laser profiler", Automation in Construction, vol. 75, pp. 91-107, 2017.
17.
M. Lepot, N. Stanić and F. H. L. R. Clemens, "A technology for sewer pipe inspection (Part 2): Experimental assessment of a new laser profiler for sewer defect detection and quantification", Automation in Construction, vol. 73, pp. 1-11, 2017.
18.
R. Rantoson, C. Stolz, D. Fofi and F. Mériaudeau, "Non contact 3D measurement scheme for transparent objects using UV structured light", 2010 20th International Conference on Pattern Recognition ICPR 2010 Laboratoire Le2i-CNRS UMR 5158 Université de Bourgogne, pp. 1646-1649, 2010.
19.
J. Kofman, J. T. Wu and K. Borribanbunpotkat, "Multiple-line full-field laser-camera range sensor", Optomechatronic Computer-Vision Systems II, vol. 6718, 2007.

Contact IEEE to Subscribe

References

References is not available for this document.