{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T06:16:15Z","timestamp":1783750575454,"version":"3.55.0"},"reference-count":46,"publisher":"ASME International","issue":"10","license":[{"start":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T00:00:00Z","timestamp":1777939200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.asme.org\/publications-submissions\/publishing-information\/legal-policies"}],"content-domain":{"domain":["asmedigitalcollection.asme.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,10,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Machining energy consumption (MEC) prediction plays an important role in energy planning, management, and conservation in the manufacturing industry. Existing MEC prediction techniques are commonly classified into physics-based models (PBMs) and data-driven approaches (DDAs), which rely on physical knowledge and data learning, respectively. While DDAs alleviate limitations associated with PBMs due to assumptions needed to simplify the complexity, most of them ignore the underlying physical knowledge and may struggle with generalization under varying machining conditions. Moreover, machining data is inherently heterogeneous in modalities, such as sensor signals and process parameters, making data fusion another challenge. To address the above issues, this article proposes a physics-informed multimodal transformer (PIMT) model for MEC prediction. First, based on the studies of machining energy nature, a synthetic data augmentation strategy is proposed to incorporate energy-relevant physical principles from PBMs. Second, a structured multimodal network is designed to align and fuse features from diverse data modalities. Then, a transformer with multihead attention is employed to capture complex temporal dependencies and cross-modal interactions within the fused data. Finally, three groups of comparative experiments with different machine tools, materials, cutting tools, and machining parameters are designed to validate and demonstrate the proposed approaches. The results showed that the proposed PIMT model achieves the lowest root mean square error (RMSE) (0.048) and mean absolute percentage error (MAPE) (12.33%), while reducing the training time (at least 152 s, 1.7 s, and 29.9 s) and the number of trainable parameters (at least 49.7%, 51.3%, and 67.6%) compared to state-of-the-art methods. Furthermore, the PIMT model consistently produces smaller errors across nearly all evaluation metrics and accurately forecasts MEC throughout continuous machining conditions.<\/jats:p>","DOI":"10.1115\/1.4070798","type":"journal-article","created":{"date-parts":[[2026,1,7]],"date-time":"2026-01-07T12:32:00Z","timestamp":1767789120000},"update-policy":"https:\/\/doi.org\/10.1115\/crossmarkpolicy-asme","source":"Crossref","is-referenced-by-count":3,"title":["A Physics-Informed Multimodal Transformer Model for Machining Energy Consumption Prediction"],"prefix":"10.1115","volume":"26","author":[{"given":"Haiyang","family":"Zhang","sequence":"first","affiliation":[{"name":"Wuhan University of Science and Technology School of Automobile and Traffic Engineering, , \u00a0 ,","place":["Wuhan, China, 430081"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Yan","sequence":"additional","affiliation":[{"name":"Wuhan University of Science and Technology School of Automobile and Traffic Engineering, , \u00a0 ,","place":["Wuhan, China, 430081"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chong","family":"Chen","sequence":"additional","affiliation":[{"name":"Guangdong University of Technology Guangdong Provincial Key Laboratory, of Cyber-Physical System, , \u00a0 ,","place":["Guangzhou, China, 510006"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ying","family":"Liu","sequence":"additional","affiliation":[{"name":"Cardiff University Department of Mechanical Engineering, School of Engineering, , \u00a0 ,","place":["Cardiff, UK, CF24 3AA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qingtao","family":"Liu","sequence":"additional","affiliation":[{"name":"Chang'an University Key Laboratory of Road Construction Technology and Equipment of MoE, , \u00a0 ,","place":["Xi'an, China, 710064"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaolei","family":"Liang","sequence":"additional","affiliation":[{"name":"Wuhan University of Science and Technology School of Automobile and Traffic Engineering, , \u00a0 ,","place":["Wuhan, China, 430081"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhigang","family":"Jiang","sequence":"additional","affiliation":[{"name":"Wuhan University of Science and Technology Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, , \u00a0 ,","place":["Wuhan, China, 430081"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"33","published-online":{"date-parts":[[2026,5,5]]},"reference":[{"key":"2026050512394740200_CIT0001","doi-asserted-by":"publisher","first-page":"112660","DOI":"10.1016\/j.rser.2022.112660","article-title":"Resource Saving by Optimization and Machining Environments for Sustainable Manufacturing: A Review and Future Prospects","volume":"166","author":"Pimenov","year":"2022","journal-title":"Renewable Sustainable Energy Rev."},{"key":"2026050512394740200_CIT0002","volume-title":"Key World Energy Statistics 2021","author":"IEA","year":"2021"},{"key":"2026050512394740200_CIT0003","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1016\/j.matpr.2022.01.156","article-title":"Prediction of Energy Consumption of Machine Tools Using Multi-Gene Genetic Programming","volume":"58","author":"Pawanr","year":"2022","journal-title":"Mater. Today: Proc."},{"key":"2026050512394740200_CIT0004","doi-asserted-by":"publisher","first-page":"102101","DOI":"10.1016\/j.aei.2023.102101","article-title":"Energy Consumption Optimisation for Machining Processes Based on Numerical Control Programs","volume":"57","author":"Feng","year":"2023","journal-title":"Adv. Eng. Inf."},{"issue":"4","key":"2026050512394740200_CIT0005","doi-asserted-by":"publisher","first-page":"041008","DOI":"10.1115\/1.4033921","article-title":"Energy Consumption Prediction System of Mechanical Processes Based on Empirical Models and Computer-Aided Manufacturing","volume":"16","author":"He","year":"2016","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"issue":"5","key":"2026050512394740200_CIT0006","doi-asserted-by":"publisher","first-page":"1584","DOI":"10.1021\/es8016655","article-title":"Thermodynamic Analysis of Resources Used in Manufacturing Processes","volume":"43","author":"Gutowski","year":"2009","journal-title":"Environ. Sci. Technol."},{"key":"2026050512394740200_CIT0007","doi-asserted-by":"publisher","first-page":"524","DOI":"10.1016\/j.energy.2017.01.047","article-title":"A Novel Approach for Acquiring the Real-Time Energy Efficiency of Machine Tools","volume":"121","author":"Liu","year":"2017","journal-title":"Energy"},{"issue":"2","key":"2026050512394740200_CIT0008","doi-asserted-by":"publisher","first-page":"021004","DOI":"10.1115\/1.4048215","article-title":"Remaining Useful Life Prediction of Bearings Using Ensemble Learning: The Impact of Diversity in Base Learners and Features","volume":"21","author":"Shi","year":"2020","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"key":"2026050512394740200_CIT0009","doi-asserted-by":"publisher","first-page":"115402","DOI":"10.1016\/j.apenergy.2020.115402","article-title":"A Generic Energy Prediction Model of Machine Tools Using Deep Learning Algorithms","volume":"275","author":"He","year":"2020","journal-title":"Appl. Energy"},{"issue":"6","key":"2026050512394740200_CIT0010","doi-asserted-by":"publisher","first-page":"422","DOI":"10.1038\/s42254-021-00314-5","article-title":"Physics-Informed Machine Learning","volume":"3","author":"Karniadakis","year":"2021","journal-title":"Nat. Rev. Phys."},{"key":"2026050512394740200_CIT0011","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10845-025-02641-1","article-title":"Physics-Informed Machine Learning in Intelligent Manufacturing: A Review","author":"Leng","year":"2025","journal-title":"J. Intell. Manuf."},{"key":"2026050512394740200_CIT0012","doi-asserted-by":"publisher","first-page":"101504","DOI":"10.1016\/j.aei.2021.101504","article-title":"A Design Method for an Intelligent Manufacturing and Service System for Rehabilitation Assistive Devices and Special Groups","volume":"51","author":"Wang","year":"2022","journal-title":"Adv. Eng. Inf."},{"key":"2026050512394740200_CIT0013","doi-asserted-by":"publisher","first-page":"100293","DOI":"10.1016\/j.jii.2021.100293","article-title":"Energy-Efficient Scheduling of Flexible Job Shops With Complex Processes: A Case Study for the Aerospace Industry Complex Components in China","volume":"27","author":"Jiang","year":"2022","journal-title":"J. Ind. Inf. Integr."},{"key":"2026050512394740200_CIT0014","volume-title":"Energy Characteristics of Machining Systems and Its Application","author":"Liu","year":"1995"},{"issue":"1","key":"2026050512394740200_CIT0015","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1016\/j.cirp.2011.03.099","article-title":"A Study on Energy Efficiency Improvement for Machine Tools","volume":"60","author":"Mori","year":"2011","journal-title":"CIRP Ann."},{"key":"2026050512394740200_CIT0016","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1016\/j.jclepro.2012.10.015","article-title":"Modelling of Direct Energy Requirements in Mechanical Machining Processes","volume":"41","author":"Balogun","year":"2013","journal-title":"J. Cleaner Prod."},{"issue":"5\u20138","key":"2026050512394740200_CIT0017","doi-asserted-by":"publisher","first-page":"1715","DOI":"10.1007\/s00170-016-9497-0","article-title":"An Energy Consumption Optimization Strategy for CNC Milling","volume":"90","author":"Ma","year":"2017","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"2026050512394740200_CIT0018","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1016\/j.jclepro.2018.01.251","article-title":"Cumulative Energy Demand and Environmental Impact in Sustainable Machining of Inconel Superalloy","volume":"181","author":"Liu","year":"2018","journal-title":"J. Cleaner Prod."},{"key":"2026050512394740200_CIT0019","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1016\/j.jii.2019.04.003","article-title":"A Data-Driven Scheduling Approach to Smart Manufacturing","volume":"15","author":"Rossit","year":"2019","journal-title":"J. Ind. Inf. Integr."},{"issue":"23","key":"2026050512394740200_CIT0020","doi-asserted-by":"publisher","first-page":"7016","DOI":"10.1080\/00207543.2014.944281","article-title":"Estimating Machining-Related Energy Consumption of Parts at the Design Phase Based on Feature Technology","volume":"53","author":"Hu","year":"2015","journal-title":"Int. J. Prod. Res."},{"key":"2026050512394740200_CIT0021","doi-asserted-by":"publisher","first-page":"715","DOI":"10.1016\/j.cirpj.2021.07.014","article-title":"Energy Prediction for CNC Machining With Machine Learning","volume":"35","author":"Brillinger","year":"2021","journal-title":"CIRP Ann. Manuf. Technol."},{"issue":"4","key":"2026050512394740200_CIT0022","doi-asserted-by":"publisher","first-page":"041013","DOI":"10.1115\/1.4034933","article-title":"Toward a Generalized Energy Prediction Model for Machine Tools","volume":"139","author":"Bhinge","year":"2017","journal-title":"ASME J. Manuf. Sci. Eng."},{"key":"2026050512394740200_CIT0023","doi-asserted-by":"publisher","first-page":"102324","DOI":"10.1016\/j.aei.2023.102324","article-title":"A Multimodal Data Sensing and Feature Learning-Based Self-Adaptive Hybrid Approach for Machining Quality Prediction","volume":"59","author":"Sheng","year":"2024","journal-title":"Adv. Eng. Inf."},{"issue":"12","key":"2026050512394740200_CIT0024","doi-asserted-by":"publisher","first-page":"124501","DOI":"10.1115\/1.4066595","article-title":"Experimental Investigation Using Robust Deep VMD-ICA and 1D-CNN for Condition Monitoring of Roller Element Bearing","volume":"24","author":"Salunkhe","year":"2024","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"key":"2026050512394740200_CIT0025","doi-asserted-by":"publisher","first-page":"757","DOI":"10.1016\/j.cie.2019.06.052","article-title":"Energy Consumption Modelling Using Deep Learning Embedded Semi-Supervised Learning","volume":"135","author":"Chen","year":"2019","journal-title":"Comput. Ind. Eng."},{"key":"2026050512394740200_CIT0026","doi-asserted-by":"publisher","first-page":"840","DOI":"10.1016\/j.aei.2018.10.008","article-title":"Multi-Source Data Analytics for AM Energy Consumption Prediction","volume":"38","author":"Qin","year":"2018","journal-title":"Adv. Eng. Inf."},{"key":"2026050512394740200_CIT0027","doi-asserted-by":"publisher","first-page":"6000","DOI":"10.48550\/arXiv.1706.03762","article-title":"Attention Is All You Need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"2026050512394740200_CIT0028","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1016\/j.jmsy.2022.12.006","article-title":"Compound Fault Diagnosis for Industrial Robots Based on Dual-Transformer Networks","volume":"66","author":"Chen","year":"2023","journal-title":"J. Manuf. Syst."},{"issue":"1","key":"2026050512394740200_CIT0029","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1016\/j.cirp.2018.03.015","article-title":"A Hybrid Approach to Integrate Machine Learning and Process Mechanics for the Prediction of Specific Cutting Energy","volume":"67","author":"Liu","year":"2018","journal-title":"CIRP Ann."},{"issue":"23","key":"2026050512394740200_CIT0030","doi-asserted-by":"publisher","first-page":"7078","DOI":"10.1080\/00207543.2020.1756508","article-title":"Modelling and Analysis for Processing Energy Consumption of Mechanism and Data Integrated Machine Tool","volume":"58","author":"Lv","year":"2020","journal-title":"Int. J. Prod. Res."},{"key":"2026050512394740200_CIT0031","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1016\/j.jmsy.2021.10.013","article-title":"Physics-Informed Meta Learning for Machining Tool Wear Prediction","volume":"62","author":"Li","year":"2022","journal-title":"J. Manuf. Syst."},{"key":"2026050512394740200_CIT0032","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1016\/j.jmsy.2025.07.011","article-title":"Diffusion Model-Driven Smart Design and Manufacturing: Prospects and Challenges","volume":"82","author":"Leng","year":"2025","journal-title":"J. Manuf. Syst."},{"issue":"5","key":"2026050512394740200_CIT0033","doi-asserted-by":"publisher","first-page":"829","DOI":"10.1162\/neco_a_01273","article-title":"A Survey on Deep Learning for Multimodal Data Fusion","volume":"32","author":"Gao","year":"2020","journal-title":"Neural Comput."},{"key":"2026050512394740200_CIT0034","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1016\/j.jmsy.2021.01.007","article-title":"A Multi-Branch Deep Neural Network Model for Failure Prognostics Based on Multimodal Data","volume":"59","author":"Yang","year":"2021","journal-title":"J. Manuf. Syst."},{"key":"2026050512394740200_CIT0035","doi-asserted-by":"publisher","first-page":"108907","DOI":"10.1016\/j.ymssp.2022.108907","article-title":"Physics-Informed LSTM Hyperparameters Selection for Gearbox Fault Detection","volume":"171","author":"Chen","year":"2022","journal-title":"Mech. Syst. Signal Process."},{"issue":"24","key":"2026050512394740200_CIT0036","doi-asserted-by":"publisher","first-page":"5052","DOI":"10.3390\/rs13245052","article-title":"Multimodal Data and Multiscale Kernel-Based Multistream CNN for Fine Classification of a Complex Surface-Mined Area","volume":"13","author":"Qian","year":"2021","journal-title":"Remote. Sens."},{"key":"2026050512394740200_CIT0037","doi-asserted-by":"publisher","first-page":"100386","DOI":"10.1016\/j.jii.2022.100386","article-title":"A Cloud-Based Deep Learning Model in Heterogeneous Data Integration System for Lung Cancer Detection in Medical Industry 4.0","volume":"30","author":"Gu","year":"2022","journal-title":"J. Ind. Inf. Integr."},{"key":"2026050512394740200_CIT0038","doi-asserted-by":"publisher","first-page":"103076","DOI":"10.1016\/j.rcim.2025.103076","article-title":"AIGC-empowered Smart Manufacturing: Prospects and Challenges","volume":"97","author":"Leng","year":"2026","journal-title":"Rob. Comput. Integr. Manuf."},{"issue":"11","key":"2026050512394740200_CIT0039","doi-asserted-by":"publisher","first-page":"111003","DOI":"10.1115\/1.4069381","article-title":"Advancing Thermal Physics Informed PointNet Distortion Prediction Capabilities in Wire Arc Directed Energy Deposition","volume":"25","author":"Zamiela","year":"2025","journal-title":"ASME J. Comput. Inf. Sci. Eng."},{"key":"2026050512394740200_CIT0040","doi-asserted-by":"publisher","first-page":"102794","DOI":"10.1016\/j.jag.2022.102794","article-title":"Multi-Modal Fusion of Satellite and Street-View Images for Urban Village Classification Based on a Dual-Branch Deep Neural Network","volume":"109","author":"Chen","year":"2022","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"2026050512394740200_CIT0041","doi-asserted-by":"publisher","first-page":"114693","DOI":"10.1016\/j.eswa.2021.114693","article-title":"Driver Stress Detection via Multimodal Fusion Using Attention-Based CNN-LSTM","volume":"173","author":"Mou","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"2026050512394740200_CIT0042","doi-asserted-by":"publisher","first-page":"118178","DOI":"10.1016\/j.eswa.2022.118178","article-title":"PSO Driven Designing of Robust and Computation Efficient 1D-CNN Architecture for Transmission Line Fault Detection","volume":"210","author":"Mitra","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"2026050512394740200_CIT0043","doi-asserted-by":"publisher","first-page":"101973","DOI":"10.1016\/j.aei.2023.101973","article-title":"A new Supervised Multi-Head Self-Attention Autoencoder for Health Indicator Construction and Similarity-Based Machinery RUL Prediction","volume":"56","author":"Qin","year":"2023","journal-title":"Adv. Eng. Inf."},{"key":"2026050512394740200_CIT0044","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1016\/j.jmsy.2018.05.011","article-title":"Long Short-Term Memory for Machine Remaining Life Prediction","volume":"48","author":"Zhang","year":"2018","journal-title":"J. Manuf. Syst."},{"issue":"11","key":"2026050512394740200_CIT0045","doi-asserted-by":"publisher","first-page":"114001","DOI":"10.1088\/1361-6501\/ac7c5b","article-title":"Spatial Attention-Based Convolutional Transformer for Bearing Remaining Useful Life Prediction","volume":"33","author":"Chen","year":"2022","journal-title":"Meas. Sci. Technol."},{"key":"2026050512394740200_CIT0046","doi-asserted-by":"publisher","first-page":"107919","DOI":"10.1016\/j.ress.2021.107919","article-title":"An Integrated Deep Learning-Based Approach for Automobile Maintenance Prediction with GIS Data","volume":"216","author":"Chen","year":"2021","journal-title":"Reliab. Eng. Syst. Saf."}],"container-title":["Journal of Computing and Information Science in Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/26\/10\/101002\/7582795\/jcise-25-1455.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article-pdf\/26\/10\/101002\/7582795\/jcise-25-1455.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T16:39:52Z","timestamp":1777999192000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmedigitalcollection.asme.org\/computingengineering\/article\/26\/10\/101002\/1229825\/A-Physics-Informed-Multimodal-Transformer-Model"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,5]]},"references-count":46,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2026,10,1]]}},"URL":"https:\/\/doi.org\/10.1115\/1.4070798","relation":{},"ISSN":["1530-9827","1944-7078"],"issn-type":[{"value":"1530-9827","type":"print"},{"value":"1944-7078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,5]]},"article-number":"101002"}}