{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,7]],"date-time":"2026-02-07T21:41:42Z","timestamp":1770500502726,"version":"3.49.0"},"reference-count":64,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2023,5,27]],"date-time":"2023-05-27T00:00:00Z","timestamp":1685145600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"European Union\u2019s Horizon 2020 programme","award":["871319"],"award-info":[{"award-number":["871319"]}]},{"name":"Software and Systems Engineering research group of Mondragon Unibertsitatea","award":["IT1519-22"],"award-info":[{"award-number":["IT1519-22"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Softw. Eng. Methodol."],"published-print":{"date-parts":[[2023,10,31]]},"abstract":"<jats:p>\n            Industrial elevator systems are commonly used software systems in our daily lives, which operate in uncertain environments such as unpredictable passenger traffic, uncertain passenger attributes and behaviors, and hardware delays. Understanding and assessing the robustness of such systems under various uncertainties enable system designers to reason about uncertainties, especially those leading to low system robustness, and consequently improve their designs and implementations in terms of handling uncertainties. To this end, we present a comprehensive empirical study conducted with industrial elevator systems provided by our industrial partner Orona, which focuses on assessing the robustness of a dispatcher\u2014that is, a software component responsible for elevators\u2019 optimal scheduling. In total, we studied 90 industrial dispatchers in our empirical study. Based on the experience gained from the study, we derived an uncertainty-aware robustness assessment method (named\n            <jats:italic>UncerRobua<\/jats:italic>\n            ) comprising a set of guidelines on how to conduct the robustness assessment and a newly proposed ranking algorithm, for supporting the robustness assessment of industrial elevator systems against uncertainties.\n          <\/jats:p>","DOI":"10.1145\/3576041","type":"journal-article","created":{"date-parts":[[2022,12,12]],"date-time":"2022-12-12T14:49:46Z","timestamp":1670856586000},"page":"1-51","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Uncertainty-Aware Robustness Assessment of Industrial Elevator Systems"],"prefix":"10.1145","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1676-8263","authenticated-orcid":false,"given":"Liping","family":"Han","sequence":"first","affiliation":[{"name":"Nanjing University of Aeronautics and Astronautics and Simula Research Laboratory"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9979-3519","authenticated-orcid":false,"given":"Shaukat","family":"Ali","sequence":"additional","affiliation":[{"name":"Simula Research Laboratory"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3262-5577","authenticated-orcid":false,"given":"Tao","family":"Yue","sequence":"additional","affiliation":[{"name":"Simula Research Laboratory"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7507-5080","authenticated-orcid":false,"given":"Aitor","family":"Arrieta","sequence":"additional","affiliation":[{"name":"Mondragon University"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9880-0764","authenticated-orcid":false,"given":"Maite","family":"Arratibel","sequence":"additional","affiliation":[{"name":"Orona"}]}],"member":"320","published-online":{"date-parts":[[2023,5,27]]},"reference":[{"key":"e_1_3_4_2_2","volume-title":"Design of Mutant Operators for the C Programming Language","author":"Agrawal Hiralal","year":"1989","unstructured":"Hiralal Agrawal, Richard DeMillo, R_ Hathaway, William Hsu, Wynne Hsu, Edward W. Krauser, Rhonda J. Martin, Aditya P. Mathur, and Eugene Spafford. 1989. Design of Mutant Operators for the C Programming Language. Technical Report. Department of Computer Sciences, Purdue University."},{"issue":"6","key":"e_1_3_4_3_2","first-page":"110","article-title":"Evaluating the elevator passenger average travelling time under incoming traffic conditions using analytical formulae and the Monte Carlo method","volume":"61","author":"Al-Sharif Lutfi","year":"2013","unstructured":"Lutfi Al-Sharif, O. F. Abdel Aal, and A. M. Abu Alqumsan. 2013. Evaluating the elevator passenger average travelling time under incoming traffic conditions using analytical formulae and the Monte Carlo method. Elevator World 61, 6 (2013), 110\u2013123.","journal-title":"Elevator World"},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.1177\/0143624416652182"},{"key":"e_1_3_4_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/bs.adcom.2017.06.001"},{"key":"e_1_3_4_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/AST52587.2021.00012"},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE5003.2020.00019"},{"key":"e_1_3_4_8_2","doi-asserted-by":"publisher","DOI":"10.3390\/en13236161"},{"key":"e_1_3_4_9_2","volume-title":"Transportation Systems in Buildings: CIBSE Guide D: 2010","author":"Barney Gina","year":"2010","unstructured":"Gina Barney. 2010. Transportation Systems in Buildings: CIBSE Guide D: 2010. Chartered Institution of Building Services Engineers, London."},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2018.00015"},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST49551.2021.00019"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3527451"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/EIT48999.2020.9208273"},{"key":"e_1_3_4_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.csite.2020.100616"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.114.3.494"},{"key":"e_1_3_4_16_2","unstructured":"Jeroen Leonard De Jong. 2012. Heuristics in Dynamic Scheduling: A Practical Framework with a Case Study in Elevator Dispatching . Ph.D. thesis. Delft University of Technology."},{"key":"e_1_3_4_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10694-016-0597-z"},{"key":"e_1_3_4_18_2","doi-asserted-by":"publisher","DOI":"10.1142\/S0219622013500223"},{"key":"e_1_3_4_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIE.2013.2289867"},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007465528199"},{"key":"e_1_3_4_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.engstruct.2018.01.018"},{"key":"e_1_3_4_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3558955"},{"key":"e_1_3_4_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2017.2748129"},{"key":"e_1_3_4_24_2","doi-asserted-by":"publisher","DOI":"10.1038\/sj.ijo.0801715"},{"key":"e_1_3_4_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2009.04.006"},{"key":"e_1_3_4_26_2","unstructured":"Tuuli Kauppala. 2021. Developmental Trajectories of Height Weight and BMI Across Childhood: Bayesian Hierarchical Modeling of Longitudinal Data . Master\u2019s thesis. Helsingfors University."},{"key":"e_1_3_4_27_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12889-015-2506-7"},{"key":"e_1_3_4_28_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.indmarman.2018.04.014"},{"key":"e_1_3_4_29_2","article-title":"Schedulability analysis of real-time systems with uncertain worst-case execution times","author":"Lee Jaekwon","year":"2020","unstructured":"Jaekwon Lee, Seung Yeob Shin, Shiva Nejati, Lionel C. Briand, and Yago Isasi Parache. 2020. Schedulability analysis of real-time systems with uncertain worst-case execution times. arXiv preprint arXiv:2007.10490 (2020).","journal-title":"arXiv preprint arXiv:2007.10490"},{"key":"e_1_3_4_30_2","article-title":"Learning configurations of operating environment of autonomous vehicles to maximize their collisions","author":"Lu Chengjie","year":"2022","unstructured":"Chengjie Lu, Yize Shi, Huihui Zhang, Man Zhang, Tiexin Wang, Tao Yue, and Shaukat Ali. 2022. Learning configurations of operating environment of autonomous vehicles to maximize their collisions. IEEE Transactions on Software Engineering. Early access, February 14, 2022.","journal-title":"IEEE Transactions on Software Engineering."},{"key":"e_1_3_4_31_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-018-00703-y"},{"key":"e_1_3_4_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-021-09941-z"},{"key":"e_1_3_4_33_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11219-018-9437-3"},{"key":"e_1_3_4_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.wear.2021.203872"},{"key":"e_1_3_4_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.heliyon.2019.e01838"},{"key":"e_1_3_4_36_2","first-page":"1","article-title":"Vertical transportation configuration: Design approach and traffic analysis theory","volume":"88","author":"Mathews T. A. K.","year":"2007","unstructured":"T. A. K. Mathews and Raghavan Nalini. 2007. Vertical transportation configuration: Design approach and traffic analysis theory. Journal of the Indian Institute of Engineers 88 (2007), 1\u20134.","journal-title":"Journal of the Indian Institute of Engineers"},{"key":"e_1_3_4_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3338906.3338920"},{"key":"e_1_3_4_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISORC.2016.17"},{"key":"e_1_3_4_39_2","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/8047490"},{"key":"e_1_3_4_40_2","volume-title":"Proceedings of the Annual Meeting of the Florida Association of Institutional Research","author":"Romano Jeanine","year":"2006","unstructured":"Jeanine Romano, Jeffrey D. Kromrey, Jesse Coraggio, and Jeff Skowronek. 2006. Should we really be using t-test and Cohen\u2019s d for evaluating group differences on the NSSE and other surveys. In Proceedings of the Annual Meeting of the Florida Association of Institutional Research."},{"key":"e_1_3_4_41_2","doi-asserted-by":"publisher","DOI":"10.1002\/9781118181034"},{"key":"e_1_3_4_42_2","doi-asserted-by":"publisher","DOI":"10.2307\/2529204"},{"key":"e_1_3_4_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3213846.3213852"},{"key":"e_1_3_4_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2017.2719630"},{"key":"e_1_3_4_45_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11590-017-1130-0"},{"key":"e_1_3_4_46_2","unstructured":"Chakkrit Tantithamthavorn. 2019. Non-parametric Scott-Knott ESD. Retrieved September 2 2021 from https:\/\/github.com\/klainfo\/ScottKnottESD."},{"key":"e_1_3_4_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2584050"},{"key":"e_1_3_4_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2018.2794977"},{"key":"e_1_3_4_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jobe.2018.03.008"},{"key":"e_1_3_4_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510188"},{"key":"e_1_3_4_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICST.2017.30"},{"key":"e_1_3_4_52_2","doi-asserted-by":"publisher","DOI":"10.1002\/eqe.2793"},{"key":"e_1_3_4_53_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29044-2"},{"key":"e_1_3_4_54_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11012-019-00992-7"},{"key":"e_1_3_4_55_2","doi-asserted-by":"publisher","DOI":"10.1080\/01495739.2020.1820921"},{"key":"e_1_3_4_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICAICE51518.2020.00056"},{"key":"e_1_3_4_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3540250.3558957"},{"key":"e_1_3_4_58_2","first-page":"874","volume-title":"Applied Mechanics and Materials","author":"Yan Dong Mei","year":"2014","unstructured":"Dong Mei Yan and Li Liu. 2014. Research on elevator group control uncertainty. In Applied Mechanics and Materials, Vol. 602. Trans Tech Publications, 874\u2013877."},{"key":"e_1_3_4_59_2","doi-asserted-by":"publisher","DOI":"10.3130\/jaabe.12.149"},{"key":"e_1_3_4_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/3408301"},{"key":"e_1_3_4_61_2","doi-asserted-by":"publisher","DOI":"10.1177\/0143624414526723"},{"key":"e_1_3_4_62_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2019.03.011"},{"key":"e_1_3_4_63_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-017-0609-6"},{"key":"e_1_3_4_64_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2018.06.075"},{"key":"e_1_3_4_65_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11269-021-02883-7"}],"container-title":["ACM Transactions on Software Engineering and Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3576041","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3576041","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:39Z","timestamp":1750182579000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3576041"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,27]]},"references-count":64,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,10,31]]}},"alternative-id":["10.1145\/3576041"],"URL":"https:\/\/doi.org\/10.1145\/3576041","relation":{},"ISSN":["1049-331X","1557-7392"],"issn-type":[{"value":"1049-331X","type":"print"},{"value":"1557-7392","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,27]]},"assertion":[{"value":"2022-02-06","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-11-18","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-05-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}