{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T18:42:48Z","timestamp":1772476968069,"version":"3.50.1"},"reference-count":36,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2025,12,26]],"date-time":"2025-12-26T00:00:00Z","timestamp":1766707200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Research and Development Program of China-Industrial Software:Technology for Autonomous Operation and Control of Complex Equipment","award":["2024YFB3310701"],"award-info":[{"award-number":["2024YFB3310701"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In complex industrial environments, surveillance videos often exhibit large parallax, low illumination, low texture, and low overlap rate, making it difficult to extract reliable image feature points and consequently leading to video suboptimal stitching performance. To address these challenges, this study proposes a real-time panoramic surveillance video stitching method specifically designed for complex industrial scenarios. In the image registration stage, the Efficient Channel Attention (ECA) and Channel Attention (CA) modules are integrated with ResNet to enhance the feature extraction layers of the UDIS algorithm, thereby improving feature extraction and matching accuracy. A loss function incorporating similarity loss Lsim and smoothness loss Lsmooth is designed to optimize registration errors. In the image fusion stage, gradient terms and motion terms are introduced for improving the energy function of the optimal seam line, enabling the optimal seam line to avoid moving objects in overlapping regions and thus achieve video stitching. Experimental validation is conducted by comparing the proposed image registration method with SIFT + RANSAC, UDIS, UDIS++, and NIS, and the proposed image fusion method with weighted average fusion, dynamic programming, and graph cut. The results show that, in image registration experiments, the proposed method achieves RMSE, PSNR, and SSIM values of 1.965, 25.338, and 0.8366, respectively. In image fusion experiments, the seam transition is smoother and effectively avoids moving objects, significantly improving the visual quality of the stitched videos. Moreover, the real-time stitching frame rate reaches 23 fps, meeting the real-time requirements of industrial surveillance applications.<\/jats:p>","DOI":"10.3390\/s26010186","type":"journal-article","created":{"date-parts":[[2025,12,29]],"date-time":"2025-12-29T00:50:42Z","timestamp":1766969442000},"page":"186","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Real-Time Panoramic Surveillance Video Stitching Method for Complex Industrial Environments"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-8418-5124","authenticated-orcid":false,"given":"Jiuteng","family":"Zhu","sequence":"first","affiliation":[{"name":"College of Ocean Science, Shandong University of Science and Technology, Qingdao 266590, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianyu","family":"Guo","sequence":"additional","affiliation":[{"name":"College of Ocean Science, Shandong University of Science and Technology, Qingdao 266590, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kailun","family":"Ding","sequence":"additional","affiliation":[{"name":"College of Ocean Science, Shandong University of Science and Technology, Qingdao 266590, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gening","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Ocean Science, Shandong University of Science and Technology, Qingdao 266590, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Youxuan","family":"Zhou","sequence":"additional","affiliation":[{"name":"College of Ocean Science, Shandong University of Science and Technology, Qingdao 266590, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenhong","family":"Li","sequence":"additional","affiliation":[{"name":"College of Ocean Science, Shandong University of Science and Technology, Qingdao 266590, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,12,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Yoon, J., and Lee, D. (2017). Real-time video stitching using camera path estimation and homography refinement. Symmetry, 10.","DOI":"10.3390\/sym10010004"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"He, B., and Yu, S. (2015). Parallax-robust surveillance video stitching. Sensors, 16.","DOI":"10.3390\/s16010007"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Huangfu, Y., Chen, H., Huang, Z., Li, W., Shi, J., and Yang, L. (2024). Research on a Panoramic Image Stitching Method for Images of Corn Ears, Based on Video Streaming. Agronomy, 14.","DOI":"10.3390\/agronomy14122884"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chen, Q., Chen, J., Sun, K., Huang, M., Chen, G., and Liu, H. (2024). A Parallel-Optimized Visualization Method for Large-Scale Multiple Video-Augmented Geographic Scenes on Cesium. ISPRS Int. J. Geo-Inf., 13.","DOI":"10.3390\/ijgi13120463"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Jia, Y., Wang, R., and Jiang, X. (2024). A real-time image stitching and fusion algorithm circuit design based on FPGA. Electronics, 13.","DOI":"10.3390\/electronics13020271"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wu, H., Bao, C., Hao, Q., Cao, J., and Zhang, L. (2024). Improved Unsupervised Stitching Algorithm for Multiple Environments SuperUDIS. Sensors, 24.","DOI":"10.3390\/s24165352"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Trigka, M., and Dritsas, E. (2025). A comprehensive survey of deep learning approaches in image processing. Sensors, 25.","DOI":"10.3390\/s25020531"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, Y., Yu, M., Jiang, G., Pan, Z., and Lin, J. (2020). Image registration algorithm based on convolutional neural network and local homography transformation. Appl. Sci., 10.","DOI":"10.3390\/app10030732"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Du, X., Zheng, L., Zhu, J., Cen, H., and He, Y. (2024). Evaluation of Mosaic Image Quality and Analysis of Influencing Factors Based on UAVs. Drones, 8.","DOI":"10.3390\/drones8040143"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wang, C., Wang, H., Han, Q., Zhang, Z., Kong, D., and Zou, X. (2024). Strawberry detection and ripeness classification using yolov8+ model and image processing method. Agriculture, 14.","DOI":"10.3390\/agriculture14050751"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Sibilano, E., Delprete, C., Marvulli, P.M., Brunetti, A., Marino, F., Lucarelli, G., Battaglia, M., and Bevilacqua, V. (2025). Deep Learning Strategies for Semantic Segmentation in Robot-Assisted Radical Prostatectomy. Appl. Sci., 15.","DOI":"10.3390\/app151910665"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhang, J., Wang, C., Liu, S., Jia, L., Ye, N., Wang, J., Zhou, J., and Sun, J. (2020, January 23\u201328). Content-aware unsupervised deep homography estimation. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58452-8_38"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"763","DOI":"10.1109\/LSP.2021.3070525","article-title":"End-to-end image stitching network via multi-homography estimation","volume":"28","author":"Song","year":"2021","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"6184","DOI":"10.1109\/TIP.2021.3092828","article-title":"Unsupervised deep image stitching: Reconstructing stitched features to images","volume":"30","author":"Nie","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhou, S., Wang, L., Chen, Z., Zheng, H., Lin, Z., and He, L. (2025). An improved YOLOv9s algorithm for underwater object detection. J. Mar. Sci. Eng., 13.","DOI":"10.3390\/jmse13020230"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"29452","DOI":"10.1109\/JSEN.2024.3436051","article-title":"A fast unsupervised image stitching model based on homography estimation","volume":"24","author":"Ni","year":"2024","journal-title":"IEEE Sens. J."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhang, T., Yin, Q., Li, S., Guo, T., and Fan, Z. (2025). An Optimized Genetic Algorithm-Based Wavelet Image Fusion Technique for PCB Detection. Appl. Sci., 15.","DOI":"10.3390\/app15063217"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Chen, J., Luo, Y., Wang, J., Tang, H., Tang, Y., and Li, J. (2024). Elimination of irregular boundaries and seams for UAV image stitching with a diffusion model. Remote Sens., 16.","DOI":"10.3390\/rs16091483"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4915","DOI":"10.1007\/s00371-022-02637-5","article-title":"A simple yet effective image stitching with computational suture zone","volume":"39","author":"Zhang","year":"2023","journal-title":"Vis. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Wang, Z., Zhang, H.W., Dai, Y.Q., Cui, K., Wang, H., Chee, P.W., and Wang, R.F. (2025). Resource-Efficient Cotton Network: A Lightweight Deep Learning Framework for Cotton Disease and Pest Classification. Plants, 14.","DOI":"10.3390\/plants14132082"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"96","DOI":"10.30534\/ijatcse\/2020\/1891.12020","article-title":"Feature-based automatic image stitching using SIFT, KNN and RANSAC","volume":"9","author":"Caparas","year":"2020","journal-title":"Int. J. Adv. Trends Comput. Sci. Eng"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Nie, L., Lin, C., Liao, K., Liu, S., and Zhao, Y. (2023, January 2\u20133). Parallax-tolerant unsupervised deep image stitching. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Paris, France.","DOI":"10.1109\/ICCV51070.2023.00680"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kim, M., Lee, J., Lee, B., Im, S., and Jin, K.H. (2024, January 3\u20138). Implicit neural image stitching with enhanced and blended feature reconstruction. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.","DOI":"10.1109\/WACV57701.2024.00404"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Chang, J., Li, Q., Liang, Y., and Zhou, L. (2024). SC-AOF: A sliding camera and asymmetric optical-flow-based blending method for image stitching. Sensors, 24.","DOI":"10.20944\/preprints202404.1791.v1"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Nghonda Tchinda, E., Panoff, M.K., Tchuinkou Kwadjo, D., and Bobda, C. (2023). Semi-supervised image stitching from unstructured camera arrays. Sensors, 23.","DOI":"10.3390\/s23239481"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"111874","DOI":"10.1016\/j.optlastec.2024.111874","article-title":"Image stitching method for CMOS grayscale cameras in industrial applications","volume":"181","author":"Liu","year":"2025","journal-title":"Opt. Laser Technol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1007\/s11554-023-01275-x","article-title":"DSP-based parallel optimization for real-time video stitching","volume":"20","author":"Huang","year":"2023","journal-title":"J. Real-Time Image Process."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.patrec.2019.06.018","article-title":"GPU based parallel optimization for real time panoramic video stitching","volume":"133","author":"Du","year":"2020","journal-title":"Pattern Recognit. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hu, K.C., Lin, F.Y., Chien, C.C., Tsai, T.S., Hsia, C.H., and Chiang, J.S. (2014, January 26\u201328). Panoramic image stitching system for automotive applications. Proceedings of the 2014 IEEE International Conference on Consumer Electronics-Taiwan, Taipei, Taiwan.","DOI":"10.1109\/ICCE-TW.2014.6904058"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3460511","article-title":"Pedestrian-aware panoramic video stitching based on a structured camera array","volume":"17","author":"Zhu","year":"2021","journal-title":"ACM Trans. Multimed. Comput. Commun. Appl. (TOMM)"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., and Hu, Q. (2020, January 13\u201319). ECA-Net: Efficient channel attention for deep convolutional neural networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01155"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Hou, Q., Zhou, D., and Feng, J. (2021, January 19\u201325). Coordinate attention for efficient mobile network design. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01350"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"102950","DOI":"10.1016\/j.jvcir.2020.102950","article-title":"A view-free image stitching network based on global homography","volume":"73","author":"Nie","year":"2020","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Chen, K., and Wang, M. (2014, January 28\u201330). Image stitching algorithm research based on OpenCV. Proceedings of the 33rd Chinese Control Conference, Nanjing, China.","DOI":"10.1109\/ChiCC.2014.6896208"},{"key":"ref_35","unstructured":"Shamir, A., and Avidan, S. (2007, January 5\u20139). Seam carving for content-aware image resizing. Proceedings of the Proceeding SIGGRAPH, San Diego, CA, USA."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1145\/882262.882264","article-title":"Graphcut textures: Image and video synthesis using graph cuts","volume":"22","author":"Kwatra","year":"2003","journal-title":"Acm Trans. Graph. (tog)"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/1\/186\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,30]],"date-time":"2025-12-30T05:27:16Z","timestamp":1767072436000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/1\/186"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,26]]},"references-count":36,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1]]}},"alternative-id":["s26010186"],"URL":"https:\/\/doi.org\/10.3390\/s26010186","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,26]]}}}