{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:23:42Z","timestamp":1760239422240,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2020,11,20]],"date-time":"2020-11-20T00:00:00Z","timestamp":1605830400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Liquid leakage from pipelines is a critical issue in large-scale chemical process plants since it can affect the normal operation of the plant and pose unsafe and hazardous situations. Therefore, leakage detection in the early stages can prevent serious damage. Developing a vision-based inspection system by means of IR imaging can be a promising approach for accurate leakage detection. IR cameras can capture the effect of leaking drops if they have higher (or lower) temperature than their surroundings. Since the leaking drops can be observed in an IR video as a repetitive phenomenon with specific patterns, motion pattern detection methods can be utilized for leakage detection. In this paper, an approach based on the Kalman filter is proposed to track the motion of leaking drops and differentiate them from noise. The motion patterns are learned from the training data and applied to the test data to evaluate the accuracy of the method. For this purpose, a laboratory demonstrator plant is assembled to simulate the leakages from pipelines, and to generate training and test videos. The results show that the proposed method can detect the leaking drops by tracking them based on obtained motion patterns. Furthermore, the possibilities and conditions for applying the proposed method in a real industrial chemical plant are discussed at the end.<\/jats:p>","DOI":"10.3390\/s20226659","type":"journal-article","created":{"date-parts":[[2020,11,20]],"date-time":"2020-11-20T09:46:18Z","timestamp":1605865578000},"page":"6659","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Visual Leakage Inspection in Chemical Process Plants Using Thermographic Videos and Motion Pattern Detection"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8956-9556","authenticated-orcid":false,"given":"Mina","family":"Fahimipirehgalin","sequence":"first","affiliation":[{"name":"Institute of Automation and Information Systems, Technical University of Munich, 85748 Garching, M\u00fcnchen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Birgit","family":"Vogel-Heuser","sequence":"additional","affiliation":[{"name":"Institute of Automation and Information Systems, Technical University of Munich, 85748 Garching, M\u00fcnchen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4319-9801","authenticated-orcid":false,"given":"Emanuel","family":"Trunzer","sequence":"additional","affiliation":[{"name":"Institute of Automation and Information Systems, Technical University of Munich, 85748 Garching, M\u00fcnchen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthias","family":"Odenweller","sequence":"additional","affiliation":[{"name":"Evonik Technology and Infrastructure GmbH, 63457 Hanau, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,20]]},"reference":[{"key":"ref_1","unstructured":"Scott, S.L., and Barrufet, M.A. (2003). Worldwide Assessment of Industry Leak Detection Capabilities for Single and Multiphase Pipelines, Offshore Technology Research Center."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1452","DOI":"10.1016\/j.ssci.2012.01.011","article-title":"Quantitative risk assessment model of hazardous chemicals leakage and application","volume":"50","author":"Si","year":"2012","journal-title":"Saf. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Barz, T., Bonow, G., Hegenberg, J., Habib, A., Cramar, L., Welle, J., Schulz, D., Kroll, A., and Schmidt, L. (2012, January 4\u20136). Unmanned Inspection of Large Industrial Environments. Proceedings of the 7th Security Research Conference, Future Security 2012, Bonn, Germany.","DOI":"10.1007\/978-3-642-33161-9_32"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"429","DOI":"10.2166\/ws.2014.131","article-title":"A review of methods for burst\/leakage detection and location in water distribution systems","volume":"15","author":"Li","year":"2014","journal-title":"Water Supply"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Vollmer, M., and M\u00f6llmann, K.-P. (2017). Infrared Thermal Imaging: Fundamentals, Research and Applications, Wiley. Available online: http:\/\/onlinelibrary.wiley.com\/book\/10.1002\/9783527693306.","DOI":"10.1002\/9783527693306"},{"key":"ref_6","unstructured":"Moulijn, J.A., Makkee, M., and van Diepen, A. (2013). Chemical Process Technology, John Wiley & Sons Inc."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/S0166-3615(96)00075-9","article-title":"A review of machine vision sensors for tool condition monitoring","volume":"34","author":"Kurada","year":"1997","journal-title":"Comput. Ind."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"630","DOI":"10.1016\/j.rcim.2007.02.005","article-title":"Design and application of industrial machine vision systems","volume":"23","author":"Golnabi","year":"2007","journal-title":"Robot. Comput. Manuf."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1016\/j.engstruct.2016.01.040","article-title":"Leak detection in liquid transmission pipelines using simplified pressure analysis techniques employing a minimum of standard and non-standard measuring devices","volume":"113","author":"Ostapkowicz","year":"2016","journal-title":"Eng. Struct."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.jhazmat.2017.02.039","article-title":"A method for simulating the entire leaking process and calculating the liquid leakage volume of a damaged pressurized pipeline","volume":"332","author":"He","year":"2017","journal-title":"J. Hazard. Mater."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"852","DOI":"10.1016\/j.petrol.2018.12.078","article-title":"An integrated detection and location model for leakages in liquid pipelines","volume":"175","author":"Liu","year":"2019","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.jlp.2016.03.010","article-title":"A review on different pipeline fault detection methods","volume":"41","author":"Datta","year":"2016","journal-title":"J. Loss Prev. Process. Ind."},{"key":"ref_13","unstructured":"Rubinstein, A. (2018). Fluid Leakage Detection System. (9939345B2), U.S. Patent."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/S1385-8947(03)00098-6","article-title":"Liquid pipeline leak detection system: Model development and numerical simulation","volume":"97","author":"Abhulimen","year":"2004","journal-title":"Chem. Eng. J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1109\/TIE.2014.2308133","article-title":"Data-Based Techniques Focused on Modern Industry: An Overview","volume":"62","author":"Yin","year":"2015","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1177\/1475921710384906","article-title":"Geometry-based spatial acoustic source location for spaced structures","volume":"10","author":"Ozevin","year":"2010","journal-title":"Struct. Health Monit."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.ijpvp.2012.01.001","article-title":"Novel leak localization in pressurized pipeline networks using acoustic emission and geometric connectivity","volume":"92","author":"Ozevin","year":"2012","journal-title":"Int. J. Press. Vessel. Pip."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TII.2018.2794987","article-title":"Improved PSO-based Method for Leak Detection and Localization in Liquid Pipelines","volume":"14","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1016\/j.jlp.2014.10.001","article-title":"Integrated-signal-based leak location method for liquid pipelines","volume":"32","author":"Sun","year":"2014","journal-title":"J. Loss Prev. Process. Ind."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1016\/j.measurement.2009.12.022","article-title":"A SVM-based pipeline leakage detection and pre-warning system","volume":"43","author":"Qu","year":"2010","journal-title":"Measurement"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1016\/j.petrol.2005.05.004","article-title":"Leak detection in petroleum pipelines using a fuzzy system","volume":"49","author":"Morooka","year":"2005","journal-title":"J. Pet. Sci. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1216","DOI":"10.1016\/j.ifacol.2015.09.692","article-title":"A Method of Leakage Location in Water Distribution Networks using Artificial Neuro-Fuzzy System","volume":"48","author":"Wachla","year":"2015","journal-title":"IFAC-PapersOnLine"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1016\/0034-4257(82)90055-4","article-title":"Application of thermal infrared imagery to canal leakage detection","volume":"12","author":"Nellis","year":"1982","journal-title":"Remote Sens. Environ."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Adefila, K., Yan, Y., Wang, T., and Kehinde, A. (2015, January 11\u201314). Leakage detection of gaseous CO2 through thermal imaging. Proceedings of the 2015 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) Proceedings, Pisa, Italy.","DOI":"10.1109\/I2MTC.2015.7151276"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Kroll, A., Baetz, W., and Peretzki, D. (2009, January 12\u201317). On autonomous detection of pressured air and gas leaks using passive IR-thermography for mobile robot application. Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan.","DOI":"10.1109\/ROBOT.2009.5152337"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Dai, D., Wang, X., Zhang, Y., Zhao, L., and Li, J. (2017, January 14\u201315). Leakage Region Detection of Gas Insulated Equipment by Applying Infrared Image Processing Technique. Proceedings of the 2017 9th International Conference on Measuring Technology and Mechatronics Automation (ICMTMA), Changsha, China.","DOI":"10.1109\/ICMTMA.2017.0030"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1016\/j.autcon.2015.10.006","article-title":"Multi-tier method using infrared photography and GPR to detect and locate water leaks","volume":"61","author":"Atef","year":"2016","journal-title":"Autom. Constr."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1002\/mawe.200900424","article-title":"Monitoring of oil leakage from a ship propulsion system using IR camera and wavelet analysis for prevention of health and ecology risks and engine faults","volume":"40","author":"Soda","year":"2009","journal-title":"Mater. Werkst."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Fahimipirehgalin, M., Trunzer, E., Odenweller, M., and Vogel-Heuser, B. (2019, January 22\u201326). Automatic Visual Leakage Inspection by Using Thermographic Video and Image Analysis. Proceedings of the 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE), Vancouver, BC, Canada.","DOI":"10.1109\/COASE.2019.8842941"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Ojha, S., and Sakhare, S. (2015, January 8\u201310). Image processing techniques for object tracking in video surveillance- A survey. Proceedings of the 2015 International Conference on Pervasive Computing (ICPC), Pune, India.","DOI":"10.1109\/PERVASIVE.2015.7087180"},{"key":"ref_31","unstructured":"Grimson, W., Stauffer, C., Romano, R., and Lee, L. (1998, January 25\u201325). Using adaptive tracking to classify and monitor activities in a site. Proceedings of the 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231), Santa Barbara, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1450","DOI":"10.1109\/TPAMI.2006.176","article-title":"A system for learning statistical motion patterns","volume":"28","author":"Hu","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Basharat, A., Gritai, A., and Shah, M. (2008, January 23\u201328). Learning object motion patterns for anomaly detection and improved object detection. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA.","DOI":"10.1109\/CVPR.2008.4587510"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1109\/78.978374","article-title":"A tutorial on particle filters for online nonlinear\/non-Gaussian Bayesian tracking","volume":"50","author":"Arulampalam","year":"2002","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1109\/MAES.2010.5546308","article-title":"Particle filter theory and practice with positioning applications","volume":"25","author":"Gustafsson","year":"2010","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Bewley, A., Ge, Z., Ott, L., Ramos, F., and Upcroft, B. (2016, January 25\u201328). Simple online and realtime tracking. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1504\/IJICA.2019.102117","article-title":"The research of multi-object tracking algorithm using Kalman filtering method","volume":"10","author":"Liu","year":"2019","journal-title":"Int. J. Innov. Comput. Appl."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Li, X., Wang, K., Wang, W., and Li, Y. (2010, January 20\u201323). A multiple object tracking method using Kalman filter. Proceedings of the 2010 IEEE International Conference on Information and Automation, Harbin, China.","DOI":"10.1109\/ICINFA.2010.5512258"},{"key":"ref_39","first-page":"34","article-title":"Multiple object tracking using Kalman filter and optical flow","volume":"2","author":"Shantaiya","year":"2015","journal-title":"Eur. J. Adv. Eng. Technol."},{"key":"ref_40","first-page":"20","article-title":"Multiple Object Detection using GMM Technique and Tracking using Kalman Filter","volume":"172","author":"Chavan","year":"2017","journal-title":"Int. J. Comput. Appl."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.compag.2018.02.027","article-title":"Improved image processing-based crop detection using Kalman filtering and the Hungarian algorithm","volume":"148","author":"Hamuda","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_42","unstructured":"Emami, P., Pardalos, P.M., Elefteriadou, L., and Ranka, S. (2018, February 19). Machine Learning Methods for Solving Assignment Problems in Multi-Target Tracking. Available online: https:\/\/arxiv.org\/pdf\/1802.06897."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A New Approach to Linear Filtering and Prediction Problems","volume":"82","author":"Kalman","year":"1960","journal-title":"J. Basic Eng."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Salhi, A., Ghozzi, F., and Fakhfakh, A. (2020). Estimation for Motion in Tracking and Detection Objects with Kalman Filter. Dynamic Data Assimilation\u2014Beating the Uncertainties, IntechOpen.","DOI":"10.5772\/intechopen.92863"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Duan, Y., Zhang, X., and Li, Z. (2020). A New Quaternion-Based Kalman Filter for Human Body Motion Tracking Using the Second Estimator of the Optimal Quaternion Algorithm and the Joint Angle Constraint Method with Inertial and Magnetic Sensors. Sensors, 20.","DOI":"10.3390\/s20216018"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"103596","DOI":"10.1016\/j.robot.2020.103596","article-title":"Vehicle tracking with Kalman filter using online situation assessment","volume":"131","author":"Khalkhali","year":"2020","journal-title":"Robot. Auton. Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/22\/6659\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:35:03Z","timestamp":1760178903000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/22\/6659"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,20]]},"references-count":46,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["s20226659"],"URL":"https:\/\/doi.org\/10.3390\/s20226659","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,11,20]]}}}