{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T15:15:14Z","timestamp":1781622914219,"version":"3.54.5"},"reference-count":67,"publisher":"Association for Computing Machinery (ACM)","issue":"2","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62202079, 62132020, 62032004, and 62472062"],"award-info":[{"award-number":["62202079, 62132020, 62032004, and 62472062"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","award":["DUT24LAB126"],"award-info":[{"award-number":["DUT24LAB126"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National Key Research and Development Program of China","award":["2018YF-B1003900"],"award-info":[{"award-number":["2018YF-B1003900"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2026,2,28]]},"abstract":"<jats:p>\n                    In software engineering, empirical studies on automated fault localization (FL) methods mainly focus on general software, and substantial progress has been made. However, the applicability and efficacy of these methods in specialized, domain-specific software like industrial software remains under-explored. Such specialized software is usually characterized by complex inputs and iterative computing paradigms, which could significantly influence the effectiveness of existing FL methods. To address this gap, this study takes a typical categorical of industrial software (i.e., computer-aided engineering (CAE) projects) as a case study, to investigate the feasibility and effectiveness of state-of-the-art FL methods within CAE projects. Through the reproduction of 76 real-world bugs from three widely used CAE projects (i.e., FDS, deal.II, and MFEM), we find that even the most precise FL methods require developers to examine on average 467.18 statements before finding bugs and can take 208.13 hours to execute. The complex inputs and long-term computation characteristics of CAE projects further increase the difficulty of FL. Moreover, FL on CAE also faces challenges, such as insufficient differentiation of coverage information and missing CAE-specific FL features. Based on our findings, we improve FL on CAE projects by proposing a set of CAE main module-based features, which improve the best-performed FL method in this study (i.e., DeepFL) by 35.93% and 45%, in terms of\n                    <jats:italic toggle=\"yes\">MAR<\/jats:italic>\n                    and\n                    <jats:italic toggle=\"yes\">MFR<\/jats:italic>\n                    , respectively.\n                  <\/jats:p>","DOI":"10.1145\/3731448","type":"journal-article","created":{"date-parts":[[2025,4,21]],"date-time":"2025-04-21T12:04:47Z","timestamp":1745237087000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Is Fault Localization Effective on Industrial Software? A Case Study on Computer-Aided Engineering Projects"],"prefix":"10.1145","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1511-2158","authenticated-orcid":false,"given":"Zhilei","family":"Ren","sequence":"first","affiliation":[{"name":"School of Software, Dalian University of Technology, Dalian, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9840-872X","authenticated-orcid":false,"given":"Yue","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Software, Dalian University of Technology, Dalian, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5068-1938","authenticated-orcid":false,"given":"Xiaochen","family":"Li","sequence":"additional","affiliation":[{"name":"School of Software, Dalian University of Technology, Dalian, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8554-6365","authenticated-orcid":false,"given":"Shikai","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Dalian Maritime University, and Dalian Key Laboratory of Artificial Intelligence, Dalian, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8674-4948","authenticated-orcid":false,"given":"He","family":"Jiang","sequence":"additional","affiliation":[{"name":"School of Software, Dalian University of Technology, Key Laboratory for Ubiquitous Network and Service Software of Liaoning Province, and DUT Artificial Intelligence Institute, Dalian, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,1,20]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3432690"},{"key":"e_1_3_3_3_2","unstructured":"Rui Abreu. 2022. The bumpy road of taking automated debugging to industry. arXiv:2212.01237. Retrieved from https:\/\/arxiv.org\/abs\/2212.01237"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2009.06.035"},{"key":"e_1_3_3_5_2","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1109\/ASE.2009.25","volume-title":"Proceedings of the 2009 IEEE\/ACM International Conference on Automated Software Engineering","author":"Abreu Rui","year":"2009","unstructured":"Rui Abreu, Peter Zoeteweij, and Arjan J. C. van Gemund. 2009. Spectrum-based multiple fault localization. In Proceedings of the 2009 IEEE\/ACM International Conference on Automated Software Engineering, 88\u201399. DOI: 10.1109\/ASE.2009.25"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3183519.3183549"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","unstructured":"H. Agrawal J. R. Horgan S. London and W. E. Wong. 1995. Fault localization using execution slices and dataflow tests. In Proceedings of 6th International Symposium on Software Reliability Engineering (ISSRE \u201995) 143\u2013151. DOI: 10.1109\/ISSRE.1995.497652","DOI":"10.1109\/ISSRE.1995.497652"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1155\/2020\/4187074"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ast.2021.107223"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1080\/00051144.2021.1999129"},{"key":"e_1_3_3_11_2","unstructured":"An Ran Chen Md Nakhla Rafi Tse-Hsun Chen and Shaohua Wang. 2023. Back to the future! Studying data cleanness in defects4J and its impact on fault localization. arXiv:2310.19139. Retrieved from https:\/\/arxiv.org\/abs\/2310.19139"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3338957"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416570"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jweia.2019.05.005"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3611643.3613884"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.5555\/3155562.3155627"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2019.00116"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3593799"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3395363.3397382"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1002\/spe.2703"},{"key":"e_1_3_3_21_2","first-page":"464","volume-title":"Proceedings of the 2015 30th IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Hong Shin","year":"2015","unstructured":"Shin Hong, Byeongcheol Lee, Taehoon Kwak, Yiru Jeon, Bongsuk Ko, Yunho Kim, and Moonzoo Kim. 2015. Mutation-based fault localization for real-world multilingual programs (T). In Proceedings of the 2015 30th IEEE\/ACM International Conference on Automated Software Engineering (ASE), 464\u2013475. DOI: 10.1109\/ASE.2015.14"},{"key":"e_1_3_3_22_2","doi-asserted-by":"crossref","unstructured":"Simo Hostikka Kevin McGrattan and Anthony Hamins. 2003. Numerical modeling of pool fires using LES and finite volume method for radiation. Fire Safety Science. In Proceedings of the 7th International Symposium. International Association for Fire Safety Science (IAFSS) Worcester MA. Retrieved from https:\/\/tsapps.nist.gov\/publication\/get_pdf.cfm?pub_id=909855","DOI":"10.3801\/IAFSS.FSS.7-383"},{"key":"e_1_3_3_23_2","doi-asserted-by":"crossref","first-page":"662","DOI":"10.1109\/ASE.2009.27","volume-title":"Proceedings of the 2009 IEEE\/ACM International Conference on Automated Software Engineering","author":"Janssen Tom","year":"2009","unstructured":"Tom Janssen, Rui Abreu, and Arjan J. C. van Gemund. 2009. Zoltar: A toolset for automatic fault localization. In Proceedings of the 2009 IEEE\/ACM International Conference on Automated Software Engineering, 662\u2013664. DOI: 10.1109\/ASE.2009.27"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2010.62"},{"key":"e_1_3_3_25_2","first-page":"502","volume-title":"Proceedings of the 2019 34th IEEE\/ACM International Conference on Automated Software Engineering (ASE)","author":"Jiang Jiajun","year":"2019","unstructured":"Jiajun Jiang, Ran Wang, Yingfei Xiong, Xiangping Chen, and Lu Zhang. 2019. Combining spectrum-based fault localization and statistical debugging: An empirical study. In Proceedings of the 2019 34th IEEE\/ACM International Conference on Automated Software Engineering (ASE), 502\u2013514. DOI: 10.1109\/ASE.2019.00054"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3624741"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/581339.581397"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/2597073.2597074"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/QRS.2017.22"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2007.66"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3345628"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3293882.3330574"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3133916"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE43902.2021.00067"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3360588"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1605"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11431-023-2496-6"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468580"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/2468356.2468382"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510147"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2014.28"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1509"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2017.62"},{"key":"e_1_3_3_44_2","first-page":"12125","volume-title":"Proceedings of the IOP Conference Series: Materials Science and Engineering","volume":"95","author":"Pescaru A.","year":"2015","unstructured":"A. Pescaru, E. Oanta, T. Axinte, and A. D. Dascalescu. 2015. Extended precision data types for the development of the original computer aided engineering applications. In Proceedings of the IOP Conference Series: Materials Science and Engineering, Vol. 95. IOP Publishing, 012125."},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.21203\/rs.3.rs-2000722\/v1"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/2025113.2025157"},{"key":"e_1_3_3_47_2","volume-title":"Fundamentals of Computer-Aided Engineering","author":"Raphael Benny","year":"2003","unstructured":"Benny Raphael and Ian F. C. Smith. 2003. Fundamentals of Computer-Aided Engineering. John Wiley & Sons."},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884848"},{"key":"e_1_3_3_49_2","first-page":"30","volume-title":"Proceedings of the 18th IEEE International Conference on Automated Software Engineering","author":"Renieres M.","year":"2003","unstructured":"M. Renieres and S. P. Reiss. 2003. Fault localization with nearest neighbor queries. In Proceedings of the 18th IEEE International Conference on Automated Software Engineering, 30\u201339. DOI: 10.1109\/ASE.2003.1240292"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3092703.3092717"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3551349.3556949"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2019.00046"},{"key":"e_1_3_3_53_2","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.advengsoft.2014.05.007","article-title":"A CAD\/CAE integrated framework for structural design optimization using sequential approximation optimization","volume":"76","author":"Wang Donghui","year":"2014","unstructured":"Donghui Wang, Fan Hu, Zhenyu Ma, Zeping Wu, and Weihua Zhang. 2014. A CAD\/CAE integrated framework for structural design optimization using sequential approximation optimization. Advances in Engineering Software 76 (2014), 56\u201368.","journal-title":"Advances in Engineering Software"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2948158"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-022-10189-4"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSME.2014.40"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2521368"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/2610384.2610386"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2308.15276"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2023.111799"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510073"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/3092703.3092731"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2911283"},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/1134285.1134324"},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11704-023-2597-8"},{"issue":"2","key":"e_1_3_3_66_2","doi-asserted-by":"crossref","first-page":"182202","DOI":"10.1007\/s11704-023-2521-2","article-title":"ContextAug: model-domain failing test augmentation with contextual information","volume":"18","author":"Zhang Zhuo","year":"2024","unstructured":"Zhuo Zhang, Jianxin Xue, Deheng Yang, and Xiaoguang Mao. 2024b. ContextAug: model-domain failing test augmentation with contextual information. Frontiers of Computer Science 18, 2 (2024), 182202.","journal-title":"Frontiers of Computer Science"},{"key":"e_1_3_3_67_2","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/ICSE.2012.6227210","volume-title":"Proceedings of the 2012 34th International Conference on Software Engineering (ICSE),","author":"Zhou Jian","year":"2012","unstructured":"Jian Zhou, Hongyu Zhang, and David Lo. 2012. Where should the bugs be fixed? More accurate information retrieval-based bug localization based on bug reports. In Proceedings of the 2012 34th International Conference on Software Engineering (ICSE), 14\u201324. DOI: 10.1109\/ICSE.2012.6227210"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2892102"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3731448","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T14:03:41Z","timestamp":1768917821000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3731448"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,20]]},"references-count":67,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,2,28]]}},"alternative-id":["10.1145\/3731448"],"URL":"https:\/\/doi.org\/10.1145\/3731448","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,20]]},"assertion":[{"value":"2024-05-23","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-03-12","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-01-20","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}