{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T10:29:56Z","timestamp":1785407396395,"version":"3.56.0"},"reference-count":38,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T00:00:00Z","timestamp":1779840000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Huaneng Group Headquarters Technology Project","award":["HNKJ22-HF130"],"award-info":[{"award-number":["HNKJ22-HF130"]}]},{"name":"Beijing Natural Science Foundation\u2013Xiaomi Innovation Joint Fund Project","award":["L243013"],"award-info":[{"award-number":["L243013"]}]},{"award":["L243013"],"award-info":[{"award-number":["L243013"]}],"id":[{"id":"https:\/\/ror.org\/029f7bn57","id-type":"ROR","asserted-by":"publisher"}]},{"name":"Central Government Guides Local Science and Technology Development Fund Project","award":["246Z1813G"],"award-info":[{"award-number":["246Z1813G"]}]},{"name":"Tangshan City Applied Basic Research Science and Technology Plan Project","award":["25130201B"],"award-info":[{"award-number":["25130201B"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62303048"],"award-info":[{"award-number":["62303048"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"award":["62303048"],"award-info":[{"award-number":["62303048"]}],"id":[{"id":"https:\/\/ror.org\/01h0zpd94","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>Currently, mining material transportation in warehouses relies heavily on manual operations, which pose safety hazards and suffer from low standardization and automation. Existing automated attempts using single-sensor perception or single-arm manipulators lack robustness and adaptability in harsh mine environments. To address these gaps, this paper proposes an intelligent loading system for standardized mining material transportation based on multimodal perception and multi-arm collaboration. First, the overall architecture of the transportation and loading system is introduced, comprising five modules: a standardized carrier platform and modular transport boxes, a box locking and spreader module, a multi-sensor recognition and positioning module, a multi-manipulator collaborative loading\/unloading module, and a perception feedback and (human-controlled) overhead crane module. Next, a standardized hardware system is designed, focusing on the standardization of the separable and easily detachable carrier platform and the modularization of transport boxes, along with the locking mechanism between them, establishing the hardware foundation for the system. Subsequently, a multimodal perception data fusion and recognition positioning technology based on multiple depth cameras, UWB, and IMU is investigated to provide perceptual feedback for automated loading\/unloading. Following this, a multi-manipulator collaborative control technology based on multi-agent error consensus is developed, designing a \u201ctwo-master, two-slave\u201d structure and a collaborative control algorithm to achieve automated loading\/unloading of transport boxes. An information-based interactive monitoring software is then designed to monitor system perception data in real time and control the system\u2019s operational status, ensuring safety and controllability. Finally, the feasibility and effectiveness of the system are validated through simulations and prototype experiments. This work provides a foundation for standardized transportation and storage of mining materials and outlines a practical system-level approach.<\/jats:p>","DOI":"10.3390\/robotics15060105","type":"journal-article","created":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T11:03:27Z","timestamp":1779879807000},"page":"105","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["An Intelligent Loading System for Standardized Mining Material Transportation Based on Multimodal Perception and Multi-Arm Collaboration"],"prefix":"10.3390","volume":"15","author":[{"given":"Yaohui","family":"Wang","sequence":"first","affiliation":[{"name":"School of Mechanical, Electronic and Control Engineering, Beijing Jiaotong University, Beijing 100044, China"},{"name":"Huaneng Coal Technology Research Co., Ltd., Beijing 100070, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sheng","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Mechanical, Electronic and Control Engineering, Beijing Jiaotong University, Beijing 100044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongbo","family":"Ding","sequence":"additional","affiliation":[{"name":"School of Mechanical, Electronic and Control Engineering, Beijing Jiaotong University, Beijing 100044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ao","family":"Cao","sequence":"additional","affiliation":[{"name":"School of Mechanical, Electronic and Control Engineering, Beijing Jiaotong University, Beijing 100044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenyang","family":"Lou","sequence":"additional","affiliation":[{"name":"School of Mechanical, Electronic and Control Engineering, Beijing Jiaotong University, Beijing 100044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhidong","family":"Zhao","sequence":"additional","affiliation":[{"name":"Zhalainuoer Coal Industry Co., Ltd., Manzhouli 021410, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinyuan","family":"Zhu","sequence":"additional","affiliation":[{"name":"School of Mechanical, Electronic and Control Engineering, Beijing Jiaotong University, Beijing 100044, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9336-9090","authenticated-orcid":false,"given":"Guangrong","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Mechanical, Electronic and Control Engineering, Beijing Jiaotong University, Beijing 100044, China"},{"name":"Tangshan Research Institute, Beijing Jiaotong University, Tangshan 063000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,5,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1002\/jccs.199700052","article-title":"Coal mine intellectualization: The core technology of high quality development","volume":"44","author":"Wang","year":"2019","journal-title":"J. China Coal Soc."},{"key":"ref_2","first-page":"59","article-title":"Coal mining robot research progress and trend analysis","volume":"1","author":"Hu","year":"2021","journal-title":"J. Intell. Mine"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/978-3-030-84315-1_4","article-title":"Sustainable Smart Mining: Safe, Economical, Environmental Friendly, Digital","volume":"Volume 1","author":"Frenz","year":"2022","journal-title":"Yearbook of Sustainable Smart Mining and Energy 2021: Technical, Economic and Legal Framework"},{"key":"ref_4","first-page":"146","article-title":"Development of Intelligent Technologies and Machinery for Coal Mining in China\u2019s Underground Coal Mines","volume":"25","author":"Ge","year":"2023","journal-title":"Strateg. Study Eng."},{"key":"ref_5","first-page":"181","article-title":"System engineering and key technologies research and practice of smart mine","volume":"49","author":"Wang","year":"2024","journal-title":"J. China Coal Soc."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Huang, Z., Ge, S., He, Y., Wang, D., and Zhang, S. (2024). Research on the Intelligent System Architecture and Control Strategy of Mining Robot Crowds. Energies, 17.","DOI":"10.20944\/preprints202401.1767.v1"},{"key":"ref_7","first-page":"54","article-title":"New progress and direction of robot technology in coal mine","volume":"48","author":"Ge","year":"2023","journal-title":"J. China Coal Soc."},{"key":"ref_8","first-page":"455","article-title":"Classification system and key technology of coal mine robot","volume":"45","author":"Ge","year":"2020","journal-title":"J. China Coal Soc."},{"key":"ref_9","first-page":"78","article-title":"Research status and development trend of intelligent technologies for mine transportation equipment","volume":"1","author":"Bao","year":"2020","journal-title":"J. Intell. Mine"},{"key":"ref_10","first-page":"233","article-title":"Development trend and key technology of coal mine transportation robot in China","volume":"48","author":"Chen","year":"2020","journal-title":"Coal Sci. Technol."},{"key":"ref_11","first-page":"209","article-title":"Current status and prospects of intelligent trackless auxiliary transportation technology in coal mines","volume":"49","author":"Zhao","year":"2021","journal-title":"Coal Sci. Technol."},{"key":"ref_12","first-page":"119","article-title":"Key technologies of auxiliary transportation robots in coal mines","volume":"33","author":"Su","year":"2021","journal-title":"West-China Explor. Eng."},{"key":"ref_13","first-page":"58","article-title":"Design of Auxiliary Transport and Transfer Robot in Coal Mine","volume":"60","author":"Chen","year":"2024","journal-title":"Mod. Manuf. Technol. Equip."},{"key":"ref_14","first-page":"127","article-title":"Design of Coal Mine Auxiliary Transport Transfer robot","volume":"39","author":"Xu","year":"2024","journal-title":"Mech. Manag. Dev."},{"key":"ref_15","first-page":"147","article-title":"Research and application of intelligent robot for auxiliary transportation in Buliangou Coal Mine","volume":"47","author":"Zhou","year":"2021","journal-title":"China Coal"},{"key":"ref_16","first-page":"220","article-title":"Intelligent inspection robot system of coal mine transportation system","volume":"56","author":"Liang","year":"2024","journal-title":"Coal Eng."},{"key":"ref_17","first-page":"62","article-title":"Research on Intelligent Inspection Robot for Coal Mine Transportation System Based on TD-LTE Technology","volume":"2022","author":"Rong","year":"2022","journal-title":"China Coal Ind."},{"key":"ref_18","first-page":"213","article-title":"Research on key technologies of multi-agent control system for trackless transportation robot in coal mines","volume":"55","author":"Zhou","year":"2024","journal-title":"Saf. Coal Mines"},{"key":"ref_19","first-page":"1085","article-title":"Basic research and application practice of unmanned auxiliary transportation system in coal mine","volume":"48","author":"Bao","year":"2023","journal-title":"J. China Coal Soc."},{"key":"ref_20","first-page":"46","article-title":"The Application of Container Transshipment Mode for Mining Materials Transportation in Gaohe Energy","volume":"26","author":"Cui","year":"2017","journal-title":"Coal"},{"key":"ref_21","unstructured":"Wang, W. (2022). Research on Design and Identification and Positioning Technology of Coal Mine Auxiliary Transportation Reprint Container. [Master\u2019s Thesis, Taiyuan University of Technology]."},{"key":"ref_22","unstructured":"Tian, X. (2023). Research on Mechanical System of Mine Rail Auxiliary Transportation Container Transfer Robot. [Master\u2019s Thesis, China University of Mining and Technology]."},{"key":"ref_23","first-page":"270","article-title":"Design of mine wheeled material transport robot","volume":"50","author":"Hao","year":"2022","journal-title":"Coal Sci. Technol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"108496","DOI":"10.1016\/j.engappai.2024.108496","article-title":"Optimized single-image super-resolution reconstruction: A multimodal approach based on reversible guidance and cyclical knowledge distillation","volume":"133","author":"Yan","year":"2024","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"13005","DOI":"10.1109\/JIOT.2026.3652582","article-title":"SMNet: A Novel Compositional Generalization Model for Industrial Robot Multijoint Fault Diagnosis","volume":"13","author":"Hu","year":"2026","journal-title":"IEEE Internet Things J."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"114691","DOI":"10.1016\/j.engappai.2026.114691","article-title":"Spatial-channel collaborative multi-scale graph interaction deep transfer learning for unsupervised rotating machinery fault diagnosis","volume":"176","author":"Wang","year":"2026","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_27","first-page":"1","article-title":"Foundations & Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions","volume":"56","author":"Liang","year":"2024","journal-title":"ACM Comput. Surv."},{"key":"ref_28","first-page":"0010","article-title":"Social GAN guided multimodal trajectory prediction and MPC for autonomous driving","volume":"2","author":"Jiang","year":"2025","journal-title":"Robot Learn."},{"key":"ref_29","first-page":"1","article-title":"Review of Technology, Application Status and Development Trend in Multi-arm Cooperative Robots","volume":"59","author":"Wu","year":"2023","journal-title":"J. Mech. Eng."},{"key":"ref_30","first-page":"467","article-title":"Attitude Control for Emergency Recovery Based on Reinforcement Learning Method for Dual-arm Space Robots","volume":"57","author":"Li","year":"2025","journal-title":"J. Nanjing Univ. Aeronaut. Astronaut."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"450","DOI":"10.20517\/ir.2025.23","article-title":"Smooth and efficient motion planning of large-scale and cooperative multi-arm tunnel drilling robot","volume":"5","author":"Cui","year":"2025","journal-title":"Intell. Robot."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"4314","DOI":"10.1109\/TASE.2026.3660080","article-title":"Cooperative Control Framework for Dual-Arm Robot Enhanced by Vision Language Model and Reinforcement Learning","volume":"23","author":"Chen","year":"2026","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Wang, Y., Guo, S., Zhang, J., Ding, H., Zhang, B., Cao, A., Sun, X., Zhang, G., Tian, S., and Chen, Y. (2025). Optimized Design and Deep Vision-Based Operation Control of a Multi-Functional Robotic Gripper for an Automatic Loading System. Actuators, 14.","DOI":"10.3390\/act14060259"},{"key":"ref_34","first-page":"38","article-title":"Current Status and Development Trend of Container Twist Lock Technology","volume":"15","author":"Xie","year":"2015","journal-title":"China Water Transp."},{"key":"ref_35","unstructured":"Liu, H. (2021). Research on Target Recognition and Localization Method Based on Multi-Camera. [Master\u2019s Thesis, North China Electric Power University]."},{"key":"ref_36","first-page":"100203","article-title":"A survey of autonomous robots and multi-robot navigation: Perception, planning and collaboration","volume":"5","author":"Chen","year":"2025","journal-title":"Biomim. Intell. Robot."},{"key":"ref_37","unstructured":"General Administration of Quality Supervision, Inspection and Quarantine of the People\u2019s Republic of China and Standardization Administration of China (2026, May 21). Narrow Gauge Mine Cars\u2014Part 5: Flat Deck Car: GB\/T 2885.5-2008, Available online: https:\/\/std.samr.gov.cn\/gb\/search\/gbDetailed?id=71F772D80034D3A7E05397BE0A0AB82A."},{"key":"ref_38","unstructured":"Liu, H. (2023). Research on Motion Control and Compliant Interaction Strategy of Cooperative Manipulator. [Master\u2019s Thesis, Shandong University]."}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/15\/6\/105\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T11:43:23Z","timestamp":1779882203000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/15\/6\/105"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,27]]},"references-count":38,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2026,6]]}},"alternative-id":["robotics15060105"],"URL":"https:\/\/doi.org\/10.3390\/robotics15060105","relation":{},"ISSN":["2218-6581"],"issn-type":[{"value":"2218-6581","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,27]]}}}