{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,2]],"date-time":"2026-09-02T15:06:38Z","timestamp":1788361598409,"version":"build-2803163510"},"reference-count":34,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2025,8,20]],"date-time":"2025-08-20T00:00:00Z","timestamp":1755648000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key R&amp;D Program of China","award":["2020YFB1314100"],"award-info":[{"award-number":["2020YFB1314100"]}]},{"name":"National Key R&amp;D Program of China","award":["KYCX24_2866"],"award-info":[{"award-number":["KYCX24_2866"]}]},{"name":"Graduate Student Scientific Research Innovation Projects in Jiangsu Province","award":["2020YFB1314100"],"award-info":[{"award-number":["2020YFB1314100"]}]},{"name":"Graduate Student Scientific Research Innovation Projects in Jiangsu Province","award":["KYCX24_2866"],"award-info":[{"award-number":["KYCX24_2866"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Environmental perception is crucial for achieving autonomous driving of auxiliary haulage vehicles in underground coal mines. The complex underground environment and working conditions, such as dust pollution, uneven lighting, and sensor data abnormalities, pose challenges to multimodal fusion perception. These challenges include: (1) the lack of a reasonable and effective method for evaluating the reliability of different modality data; (2) the absence of in-depth fusion methods for different modality data that can handle sensor failures; and (3) the lack of a multimodal dataset for underground coal mines to support model training. To address these issues, this paper proposes a coal mine underground BEV multiscale-enhanced fusion perception model based on dynamic weight adjustment. First, camera and LiDAR modality data are uniformly mapped into BEV space to achieve multimodal feature alignment. Then, a Mixture of Experts-Fuzzy Logic Inference Module (MoE-FLIM) is designed to infer weights for different modality data based on BEV feature dimensions. Next, a Pyramid Multiscale Feature Enhancement and Fusion Module (PMS-FFEM) is introduced to ensure the model\u2019s perception performance in the event of sensor data abnormalities. Lastly, a multimodal dataset for underground coal mines is constructed to provide support for model training and testing in real-world scenarios. Experimental results show that the proposed method demonstrates good accuracy and stability in object-detection tasks in coal mine underground environments, maintaining high detection performance, especially in typical complex scenes such as low light and dust fog.<\/jats:p>","DOI":"10.3390\/s25165185","type":"journal-article","created":{"date-parts":[[2025,8,20]],"date-time":"2025-08-20T15:53:37Z","timestamp":1755705217000},"page":"5185","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Mine-DW-Fusion: BEV Multiscale-Enhanced Fusion Object-Detection Model for Underground Coal Mine Based on Dynamic Weight Adjustment"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-7301-4331","authenticated-orcid":false,"given":"Wanzi","family":"Yan","sequence":"first","affiliation":[{"name":"School of Mines, China University of Mining and Technology, Xuzhou 221116, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yidong","family":"Zhang","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Fine Exploration and Intelligent Development of Coal Resources, School of Mines, China University of Mining and Technology, Xuzhou 221116, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Minti","family":"Xue","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Intelligent Mining Equipment Technology, School of Mechanical and Electrical Engineering, China University of Mining and Technology, Xuzhou 221116, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhencai","family":"Zhu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Intelligent Mining Equipment Technology, School of Mechanical and Electrical Engineering, China University of Mining and Technology, Xuzhou 221116, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Lu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Intelligent Mining Equipment Technology, School of Mechanical and Electrical Engineering, China University of Mining and Technology, Xuzhou 221116, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Information and Control Engineering, China University of Mining and Technology, Xuzhou 221116, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Tang","sequence":"additional","affiliation":[{"name":"Artificial Intelligence Research Institute, China University of Mining and Technology, Xuzhou 221116, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Keke","family":"Xing","sequence":"additional","affiliation":[{"name":"School of Mines, China University of Mining and Technology, Xuzhou 221116, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,8,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1007\/s40789-022-00491-3","article-title":"Research and practice of intelligent coal mine technology systems in China","volume":"9","author":"Wang","year":"2022","journal-title":"Int. J. Coal Sci. Technol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"67","DOI":"10.4018\/JDM.2019040104","article-title":"Artificial intelligence, machine learning, and autonomous technologies in mining industry","volume":"30","author":"Hyder","year":"2019","journal-title":"J. Database Manag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1109\/TIV.2022.3197820","article-title":"Making standards for smart mining operations: Intelligent vehicles for autonomous mining transportation","volume":"7","author":"Ge","year":"2022","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_4","first-page":"567","article-title":"Response mechanism and control technology of surrounding rock in deep mine roadways under mining and excavation activities","volume":"42","author":"Wang","year":"2025","journal-title":"J. Min. Saf. Eng."},{"key":"ref_5","first-page":"592","article-title":"Determination and analysis of dust concentration and particle size in underground coal mines","volume":"48","author":"Jian","year":"2017","journal-title":"J. Taiyuan Univ. Technol."},{"key":"ref_6","unstructured":"(2015). Code for Design of Mine of Coal Industry. Ministry of Housing and Urban-Rural Development of the People\u2019s Republic of China (Standard No. GB 50215-2015). Available online: https:\/\/www.chinesestandard.net\/PDF\/English.aspx\/GB50215-2015."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"015410","DOI":"10.1088\/1361-6501\/ad060e","article-title":"Research on real-time perception method of key targets in the comprehensive excavation working face of coal mine","volume":"35","author":"Zhao","year":"2023","journal-title":"Meas. Sci. Technol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"51","DOI":"10.31449\/inf.v47i7.4799","article-title":"Clarity method of low-illumination and dusty coal mine images based on improved AMEF","volume":"47","author":"Su","year":"2023","journal-title":"Informatica"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"132592","DOI":"10.1109\/ACCESS.2024.3450582","article-title":"LDSI-YOLOv8: Real-time detection method for multiple targets in coal mine excavation scenes","volume":"12","author":"Zhang","year":"2024","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1007\/s11760-023-02801-x","article-title":"Research on low-light image enhancement based on MER-Retinex algorithm","volume":"18","author":"Zhou","year":"2024","journal-title":"Signal Image Video Process."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Tian, F., Gao, L., and Zhang, J. (2024). An Image Dehazing Algorithm for Underground Coal Mines Based on gUNet. Sensors, 24.","DOI":"10.3390\/s24113422"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"129080","DOI":"10.1016\/j.neucom.2024.129080","article-title":"Integrating real-time pose estimation and PPE detection with cutting-edge deep learning for enhanced safety and rescue operations in the mining industry","volume":"618","author":"Imam","year":"2025","journal-title":"Neurocomputing"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yang, W., Wang, Y., Zhang, X., Zhu, L., Wang, T., Chi, Y., and Jiang, J. (2025). MSS-YOLO: Multi-Scale Edge-Enhanced Lightweight Network for Personnel Detection and Location in Coal Mines. Appl. Sci., 15.","DOI":"10.3390\/app15063238"},{"key":"ref_14","first-page":"4986","article-title":"A method for evaluating the accessibility of underground auxiliary transportation vehicles in coal mines based on multi feature fusion","volume":"49","author":"Fan","year":"2024","journal-title":"J. China Coal Soc."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yang, T., Wang, S., Tong, J., and Wang, W. (2023). Accurate real-time obstacle detection of coal mine driverless electric locomotive based on ODEL-YOLOv5s. Sci. Rep., 13.","DOI":"10.1038\/s41598-023-44746-8"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wang, J., Yang, P., Liu, Y., Shang, D., Hui, X., Song, J., and Chen, X. (2023). Research on improved yolov5 for low-light environment object detection. Electronics, 12.","DOI":"10.3390\/electronics12143089"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1433","DOI":"10.1080\/01431161.2023.2184215","article-title":"Novel high-performance automatic removal method of interference points for point cloud data in coal mine roadway environment","volume":"44","author":"Xu","year":"2023","journal-title":"Int. J. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"4044","DOI":"10.1007\/s11356-022-22490-2","article-title":"Analyzing point cloud of coal mining process in much dust environment based on dynamic graph convolution neural network","volume":"30","author":"Xing","year":"2023","journal-title":"Environ. Sci. Pollut. Res."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.neucom.2023.01.094","article-title":"Class-aware tiny object recognition over large-scale 3D point clouds","volume":"529","author":"Li","year":"2023","journal-title":"Neurocomputing"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Jiang, X., Xie, Y., Na, C., Yu, W., and Meng, Y. (2024). Algorithm for Point Cloud Dust Filtering of LiDAR for Autonomous Vehicles in Mining Area. Sustainability, 16.","DOI":"10.3390\/su16072827"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1080\/2150704X.2020.1809734","article-title":"Roof bolt identification in underground coal mines from 3D point cloud data using local point descriptors and artificial neural network","volume":"42","author":"Singh","year":"2021","journal-title":"Int. J. Remote Sens."},{"key":"ref_22","unstructured":"Gao, Y. (2023). Research and Application of Automatic Driving System for Mine Monorails. [Master\u2019s Thesis, China University of Mining and Technology]."},{"key":"ref_23","unstructured":"He, S.K. (2023). Research on Unmanned Driving Environment Perception System for Mine Locomotives. [Master\u2019s Thesis, China University of Mining and Technology]."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Philion, J., and Fidler, S. (2020, January 23\u201328). Lift, splat, shoot: Encoding images from arbitrary camera rigs by implicitly unprojecting to 3D. Proceedings of the ECCV, Online Conference.","DOI":"10.1007\/978-3-030-58568-6_12"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2020","DOI":"10.1109\/TPAMI.2024.3515454","article-title":"Bevformer: Learning bird\u2019s-eye-view representation from lidar-camera via spatiotemporal transformers","volume":"47","author":"Li","year":"2024","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","first-page":"1042","article-title":"Polarformer: Multi-camera 3d object detection with polar transformer","volume":"37","author":"Jiang","year":"2023","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Liu, Y., Wang, T., Zhang, X., and Sun, J. (2022). Petr: Position embedding transformation for multi-view 3d object detection. European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-031-19812-0_31"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lang, A.H., Vora, S., Caesar, H., Zhou, L., Yang, J., and Beijbom, O. (2019, January 15\u201320). Pointpillars: Fast encoders for object detection from point clouds. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01298"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Yin, T., Zhou, X., and Krahenbuhl, P. (2021, January 20\u201325). Center-based 3d object detection and tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01161"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Liu, Z., Tang, H., Amini, A., Yang, X., Mao, H., Rus, D.L., and Han, S. (June, January 29). Bevfusion: Multi-task multi-sensor fusion with unified bird\u2019s-eye view representation. Proceedings of the 2023 IEEE International Conference on Robotics and Automation (ICRA), London, UK.","DOI":"10.1109\/ICRA48891.2023.10160968"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Harley, A.W., Fang, Z., Li, J., Ambrus, R., and Fragkiadaki, K. (2022). Simple-bev: What really matters for multi-sensor bev perception?. arXiv.","DOI":"10.1109\/ICRA48891.2023.10160831"},{"key":"ref_32","first-page":"318","article-title":"Focal Loss for Dense Object Detection","volume":"42","author":"Lin","year":"2017","journal-title":"Proc. IEEE Int. Conf. Comput. Vis."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"108436","DOI":"10.1016\/j.compeleceng.2022.108436","article-title":"Pyramid attention object detection network with multi-scale feature fusion","volume":"104","author":"Chen","year":"2022","journal-title":"Comput. Electr. Eng."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/25\/16\/5185\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:32:18Z","timestamp":1760034738000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/25\/16\/5185"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,20]]},"references-count":34,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2025,8]]}},"alternative-id":["s25165185"],"URL":"https:\/\/doi.org\/10.3390\/s25165185","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,20]]}}}