{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T21:15:34Z","timestamp":1792790134630,"version":"4.5.0"},"reference-count":34,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T00:00:00Z","timestamp":1790294400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["52204179"],"award-info":[{"award-number":["52204179"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"award":["52204179"],"award-info":[{"award-number":["52204179"]}],"id":[{"id":"https:\/\/ror.org\/01h0zpd94","id-type":"ROR","asserted-by":"publisher"}]},{"name":"Jiangsu Province Science and Technology Department","award":["BK20221128"],"award-info":[{"award-number":["BK20221128"]}],"id":[{"id":"https:\/\/ror.org\/02mkqta53","id-type":"ROR","asserted-by":"crossref"}]},{"award":["BK20221128"],"award-info":[{"award-number":["BK20221128"]}],"id":[{"id":"https:\/\/ror.org\/02mkqta53","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Fully mechanized coal faces require robust sensing of hydraulic-support face-guard pose and its clearance to the shearer drum under dust, mist, and low-light conditions. This paper presents a multi-source visual fusion framework that integrates an RGB camera, an infrared camera, and a 32-line LiDAR. The system performs modality-specific denoising, distortion correction, time synchronization, spatial registration, and adaptive feature fusion before estimating face-guard 2D boxes, 3D keypoints, and 6DoF pose. RGB and infrared features are extracted with Swin Transformer backbones, LiDAR features are encoded in BEV space, and the fused representation is refined by an axial cross-modal fusion block. The recovered pose is converted into a 3D envelope, and the minimum distance to the shearer drum is mapped to a four-level warning policy. Experiments on 2400 synchronized multimodal frames from a simulated fully mechanized mining face show 98.5% mAP@0.5 for tri-modal detection, an approximately 10 Hz integrated refresh rate, a 3D keypoint localization MAE of 1.40 cm, and a maximum environmental-condition clearance error of 2.2 cm under combined dust-and-mist disturbance. These results demonstrate the proposed method has potential application value in the field of intelligent mines.<\/jats:p>","DOI":"10.3390\/s26196082","type":"journal-article","created":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T10:34:10Z","timestamp":1790332450000},"page":"6082","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Multi-Source Visual Fusion for Face-Guard Pose Estimation and Shearer Cutting-Interference Warning in Fully Mechanized Coal Mining Faces"],"prefix":"10.3390","volume":"26","author":[{"given":"Yihui","family":"Zhao","sequence":"first","affiliation":[{"name":"School of Mechatronic Engineering, China University of Mining and Technology, No. 1 Daxue Road, Xuzhou 221116, China"},{"name":"Xi\u2019an Coal Mining Machinery Co., Ltd., No. 7 Jingpu Road, Gaoling District, Xi\u2019an 710032, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhongbin","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Mechatronic Engineering, China University of Mining and Technology, No. 1 Daxue Road, Xuzhou 221116, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dan","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Mechatronic Engineering, China University of Mining and Technology, No. 1 Daxue Road, Xuzhou 221116, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8616-2040","authenticated-orcid":false,"given":"Dong","family":"Wei","sequence":"additional","affiliation":[{"name":"School of Mechatronic Engineering, China University of Mining and Technology, No. 1 Daxue Road, Xuzhou 221116, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,25]]},"reference":[{"key":"ref_1","unstructured":"Man, Y. (2019). Research on Monitoring Technology of Cutting Interference Between Hydraulic Support Face Guard and Shearer Drum. [Master\u2019s Thesis, China University of Mining and Technology]."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1002\/rob.21701","article-title":"When the Dust Settles: The Four Behaviors of LiDAR in the Presence of Fine Airborne Particulates","volume":"34","author":"Phillips","year":"2017","journal-title":"J. Field Robot."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Afzalaghaeinaeini, A., Seo, J., Lee, D., and Lee, H. (2022). Design of Dust-Filtering Algorithms for LiDAR Sensors Using Intensity and Range Information in Off-Road Vehicles. Sensors, 22.","DOI":"10.3390\/s22114051"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"845","DOI":"10.3390\/atmos14050845","article-title":"Laser Attenuation and Ranging Correction in the Coal Dust Environment Based on Mie Theory and Phase Ranging Principle","volume":"14","author":"Li","year":"2023","journal-title":"Atmosphere"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"22032","DOI":"10.1109\/ACCESS.2024.3362804","article-title":"Dust De-Filtering in LiDAR Applications with Conventional and CNN Filtering Methods","volume":"12","author":"Parsons","year":"2024","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Cavieres, B., Cruz, N., and Ruiz-del-Solar, J. (2025). Dust Filtering in LiDAR Point Clouds Using Deep Learning for Mining Applications. Sensors, 25.","DOI":"10.20944\/preprints202509.1214.v1"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision Meets Robotics: The KITTI Dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robot. Res."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Caesar, H., Bankiti, V., Lang, A.H., Vora, S., Liong, V.E., Xu, Q., Krishnan, A., Pan, Y., Baldan, G., and Beijbom, O. (2020). nuScenes: A Multimodal Dataset for Autonomous Driving. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","DOI":"10.1109\/CVPR42600.2020.01164"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Bijelic, M., Gruber, T., Mannan, F., Kraus, F., Ritter, W., Dietmayer, K., and Heide, F. (2020). Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","DOI":"10.1109\/CVPR42600.2020.01170"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1341","DOI":"10.1109\/TITS.2020.2972974","article-title":"Deep Multi-Modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges","volume":"22","author":"Feng","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_11","unstructured":"RoboSense (2026, September 21). RS-LiDAR-32 Product Resources. Available online: https:\/\/www.robosense.cn\/resources-24."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Li, E., Wang, S., Li, C., Li, D., and Hao, Q. (2020). SUSTech POINTS: A Portable 3D Point Cloud Interactive Annotation Platform System. Proceedings of the 2020 IEEE Intelligent Vehicles Symposium (IV), Las Vegas, NV, USA, 19 October\u201313 November 2020, IEEE.","DOI":"10.1109\/IV47402.2020.9304562"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A Flexible New Technique for Camera Calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1109\/TPAMI.1987.4767965","article-title":"Least-Squares Fitting of Two 3-D Point Sets","volume":"PAMI-9","author":"Arun","year":"1987","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1109\/70.34770","article-title":"A New Technique for Fully Autonomous and Efficient 3D Robotics Hand\/Eye Calibration","volume":"5","author":"Tsai","year":"1989","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"A Method for Registration of 3-D Shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., Blodow, N., and Beetz, M. (2009). Fast Point Feature Histograms (FPFH) for 3D Registration. Proceedings of the 2009 IEEE International Conference on Robotics and Automation (ICRA), IEEE.","DOI":"10.1109\/ROBOT.2009.5152473"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021). Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), IEEE.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017). Feature Pyramid Networks for Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_21","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE."},{"key":"ref_22","unstructured":"Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017). PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. Advances in Neural Information Processing Systems 30, Curran Associates, Inc."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhou, Y., and Tuzel, O. (2018). VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","DOI":"10.1109\/CVPR.2018.00472"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yan, Y., Mao, Y., and Li, B. (2018). SECOND: Sparsely Embedded Convolutional Detection. Sensors, 18.","DOI":"10.3390\/s18103337"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Lang, A.H., Vora, S., Caesar, H., Zhou, L., Yang, J., and Beijbom, O. (2019). PointPillars: Fast Encoders for Object Detection from Point Clouds. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","DOI":"10.1109\/CVPR.2019.01298"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Chen, X., Ma, H., Wan, J., Li, B., and Xia, T. (2017). Multi-View 3D Object Detection Network for Autonomous Driving. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","DOI":"10.1109\/CVPR.2017.691"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Qi, C.R., Liu, W., Wu, C., Su, H., and Guibas, L.J. (2018). Frustum PointNets for 3D Object Detection from RGB-D Data. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","DOI":"10.1109\/CVPR.2018.00102"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1007\/978-3-030-01270-0_39","article-title":"Deep Continuous Fusion for Multi-Sensor 3D Object Detection","volume":"Volume 11220","author":"Liang","year":"2018","journal-title":"Computer Vision\u2013ECCV 2018"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Vora, S., Lang, A.H., Helou, B., and Beijbom, O. (2020). PointPainting: Sequential Fusion for 3D Object Detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","DOI":"10.1109\/CVPR42600.2020.00466"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Bai, X., Hu, Z., Zhu, X., Huang, Q., Chen, Y., Fu, H., and Tai, C.L. (2022). TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformers. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","DOI":"10.1109\/CVPR52688.2022.00116"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Liu, Z., Tang, H., Amini, A., Yang, X., Mao, H., Rus, D.L., and Han, S. (2023). BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird\u2019s-Eye View Representation. Proceedings of the 2023 IEEE International Conference on Robotics and Automation (ICRA), IEEE.","DOI":"10.1109\/ICRA48891.2023.10160968"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Tian, Z., Shen, C., Chen, H., and He, T. (2019). FCOS: Fully Convolutional One-Stage Object Detection. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), IEEE.","DOI":"10.1109\/ICCV.2019.00972"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017). Focal Loss for Dense Object Detection. Proceedings of the IEEE International Conference on Computer Vision (ICCV), IEEE.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s11263-008-0152-6","article-title":"EPnP: An Accurate O(n) Solution to the PnP Problem","volume":"81","author":"Lepetit","year":"2009","journal-title":"Int. J. Comput. Vis."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/19\/6082\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T04:26:25Z","timestamp":1790655985000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/19\/6082"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,25]]},"references-count":34,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2026,10]]}},"alternative-id":["s26196082"],"URL":"https:\/\/doi.org\/10.3390\/s26196082","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,25]]}}}