{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T06:17:40Z","timestamp":1785392260098,"version":"3.55.0"},"reference-count":138,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,2,14]],"date-time":"2024-02-14T00:00:00Z","timestamp":1707868800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"US National Science Foundation","doi-asserted-by":"crossref","award":["# CNS-1931962"],"award-info":[{"award-number":["# CNS-1931962"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100008109","name":"University of Notre Dame","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100008109","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Linz Institute of Technology","award":["LIT-2019-7-INC-316"],"award-info":[{"award-number":["LIT-2019-7-INC-316"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Auton. Adapt. Syst."],"published-print":{"date-parts":[[2024,3,31]]},"abstract":"<jats:p>\n            The Human Machine Teaming (HMT) paradigm focuses on supporting partnerships between humans and autonomous machines. HMT describes requirements for transparency, augmented cognition, and coordination that enable far richer partnerships than those found in typical human-on-the-loop and human-in-the-loop systems. Autonomous, self-adaptive systems in domains such as autonomous driving, robotics, and Cyber-Physical Systems, are often implemented using the MAPE-K feedback loop as the primary reference model. However, while MAPE-K enables fully autonomous behavior, it does not explicitly address the interactions that occur between humans and autonomous machines as intended by HMT. In this article, we, therefore, present the\n            <jats:italic>\n              MAPE-K\n              <jats:sub>HMT<\/jats:sub>\n            <\/jats:italic>\n            framework, which utilizes runtime models to augment the monitoring, analysis, planning, and execution phases of the MAPE-K loop to support HMT despite the different operational cadences of humans and machines. We draw on examples from our own emergency response system of interactive, autonomous, small unmanned aerial systems to illustrate the application of\n            <jats:italic>\n              MAPE-K\n              <jats:sub>HMT<\/jats:sub>\n            <\/jats:italic>\n            in both a simulated and physical environment, and we discuss how the various HMT models are connected and can be integrated into a MAPE-K solution.\n          <\/jats:p>","DOI":"10.1145\/3618001","type":"journal-article","created":{"date-parts":[[2023,9,4]],"date-time":"2023-09-04T12:20:51Z","timestamp":1693830051000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Human\u2013machine Teaming with Small Unmanned Aerial Systems in a MAPE-K Environment"],"prefix":"10.1145","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9436-5606","authenticated-orcid":false,"given":"Jane","family":"Cleland-Huang","sequence":"first","affiliation":[{"name":"Computer Science and Engineering, University of Notre Dame, IN, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2923-3230","authenticated-orcid":false,"given":"Theodore","family":"Chambers","sequence":"additional","affiliation":[{"name":"Computer Science and Engineering, University of Notre Dame, IN, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6532-5813","authenticated-orcid":false,"given":"Sebastian","family":"Zudaire","sequence":"additional","affiliation":[{"name":"Instituto Balseiro \u2013 Universidad Nacional de Cuyo, Argentina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5356-7316","authenticated-orcid":false,"given":"Muhammed Tawfiq","family":"Chowdhury","sequence":"additional","affiliation":[{"name":"Computer Science and Engineering, University of Notre Dame, IN, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1467-1596","authenticated-orcid":false,"given":"Ankit","family":"Agrawal","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Saint Louis University, MO, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2672-9230","authenticated-orcid":false,"given":"Michael","family":"Vierhauser","sequence":"additional","affiliation":[{"name":"LIT Secure and Correct Systems Lab, Johannes Kepler University Linz, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,2,14]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/WAIN52551.2021.00025"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376825"},{"key":"e_1_3_1_4_2","first-page":"15","volume-title":"Proceedings of the 9th AAAI Conference on Human Computation and Crowdsourcing","author":"Agrawal Ankit","year":"2021","unstructured":"Ankit Agrawal and Jane Cleland-Huang. 2021. Explaining autonomous decisions in swarms of human-on-the-loop small unmanned aerial systems. In Proceedings of the 9th AAAI Conference on Human Computation and Crowdsourcing, Ece Kamar and Kurt Luther (Eds.). AAAI Press, 15\u201326. Retrieved from https:\/\/ojs.aaai.org\/index.php\/HCOMP\/article\/view\/18936"},{"key":"e_1_3_1_5_2","article-title":"RescueAR: Augmented reality supported collaboration for UAV driven emergency response systems","volume":"2110","author":"Agrawal Ankit","year":"2021","unstructured":"Ankit Agrawal and Jane Cleland-Huang. 2021. RescueAR: Augmented reality supported collaboration for UAV driven emergency response systems. CoRR abs\/2110.00180 (2021).","journal-title":"CoRR"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/MoDRE51215.2020.00007"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/RE.2019.00034"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3341105.3373925"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/SEAMS.2015.10"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-08915-7_1"},{"issue":"2020","key":"e_1_3_1_11_2","doi-asserted-by":"crossref","first-page":"1528","DOI":"10.4271\/2020-01-0727","article-title":"Safety assurance concepts for automated driving systems","volume":"2","author":"Ballingall Stuart","year":"2020","unstructured":"Stuart Ballingall, Majid Sarvi, and Peter Sweatman. 2020. Safety assurance concepts for automated driving systems. SAE Int. J. Adv. Curr. Pract. Mobil. 2, 2020-01-0727 (2020), 1528\u20131537.","journal-title":"SAE Int. J. Adv. Curr. Pract. Mobil."},{"key":"e_1_3_1_12_2","first-page":"125","volume-title":"Proceedings of the 18th IEEE International Requirements Engineering Conference.","author":"Baresi Luciano","year":"2010","unstructured":"Luciano Baresi, Liliana Pasquale, and Paola Spoletini. 2010. Fuzzy goals for requirements-driven adaptation. In Proceedings of the 18th IEEE International Requirements Engineering Conference. IEEE, 125\u2013134."},{"key":"e_1_3_1_13_2","first-page":"168","volume-title":"Proceedings of the International Conference on Runtime Verification","author":"Bartocci Ezio","year":"2012","unstructured":"Ezio Bartocci, Radu Grosu, Atul Karmarkar, Scott A. Smolka, Scott D. Stoller, Erez Zadok, and Justin Seyster. 2012. Adaptive runtime verification. In Proceedings of the International Conference on Runtime Verification. Springer, 168\u2013182."},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/2591062.2591118"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-018-00712-x"},{"key":"e_1_3_1_16_2","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1007\/978-3-319-21155-8_8","volume-title":"Proceedings of the International Conference on Theory and Practice of Model Transformations","author":"Bergmann G\u00e1bor","year":"2015","unstructured":"G\u00e1bor Bergmann, Istv\u00e1n D\u00e1vid, \u00c1bel Heged\u00fcs, \u00c1kos Horv\u00e1th, Istv\u00e1n R\u00e1th, Zolt\u00e1n Ujhelyi, and D\u00e1niel Varr\u00f3. 2015. Viatra 3: A reactive model transformation platform. In Proceedings of the International Conference on Theory and Practice of Model Transformations. Springer, 101\u2013110."},{"key":"e_1_3_1_17_2","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1007\/978-3-319-60591-3_5","volume-title":"Proceedings of the AHFE International Conference on Human Factors in Simulation and Modeling","author":"Bindewald Jason M.","year":"2018","unstructured":"Jason M. Bindewald, Christina F. Rusnock, and Michael E Miller. 2018. Measuring human trust behavior in human\u2013machine teams. In Proceedings of the AHFE International Conference on Human Factors in Simulation and Modeling. Springer, 47\u201358."},{"key":"e_1_3_1_18_2","first-page":"1878","volume-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"62","author":"Biondi Francesco N.","year":"2018","unstructured":"Francesco N. Biondi, Monika Lohani, Rachel Hopman, Sydney Mills, Joel M. Cooper, and David L. Strayer. 2018. 80 MPH and out-of-the-loop: Effects of real-world semi-automated driving on driver workload and arousal. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 62. SAGE Publications, 1878\u20131882."},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2004.1317503"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/2804337.2804339"},{"key":"e_1_3_1_21_2","first-page":"377","volume-title":"Software Engineering for Self-Adaptive Systems III. Assurances","author":"Braberman Victor","year":"2017","unstructured":"Victor Braberman, Nicolas D\u2019Ippolito, Jeff Kramer, Daniel Sykes, and Sebastian Uchitel. 2017. An extended description of MORPH: A reference architecture for configuration and behaviour self-adaptation. In Software Engineering for Self-Adaptive Systems III. Assurances. Springer International Publishing, Cham, 377\u2013408."},{"key":"e_1_3_1_22_2","first-page":"72","volume-title":"Proceedings of the 13th International WS on Models@run.time Conference","author":"Brand Thomas","year":"2018","unstructured":"Thomas Brand and Holger Giese. 2018. Towards software architecture runtime models for continuous adaptive monitoring. In Proceedings of the 13th International WS on Models@run.time Conference. 72\u201377."},{"key":"e_1_3_1_23_2","first-page":"227","volume-title":"Proceedings of the ACM\/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems (MODELS\u201919)","author":"Brand Thomas","year":"2019","unstructured":"Thomas Brand and Holger Giese. 2019. Modeling approach and evaluation criteria for adaptable architectural runtime model instances. In Proceedings of the ACM\/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems (MODELS\u201919). IEEE, 227\u2013232."},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3341105.3374011"},{"key":"e_1_3_1_25_2","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1007\/978-3-319-41959-6_10","volume-title":"Advances in Human Factors in Robots and Unmanned Systems","author":"Calhoun Gloria L.","year":"2017","unstructured":"Gloria L. Calhoun, Heath A. Ruff, Kyle J. Behymer, and Elizabeth Marie Mersch. 2017. Operator-autonomy teaming interfaces to support multi-unmanned vehicle missions. In Advances in Human Factors in Robots and Unmanned Systems. Springer, 113\u2013126."},{"key":"e_1_3_1_26_2","first-page":"90","volume-title":"Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems","author":"Calinescu Radu","year":"2021","unstructured":"Radu Calinescu, Naif Alasmari, and Mario Gleirscher. 2021. Maintaining driver attentiveness in shared-control autonomous driving. In Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 90\u201396."},{"issue":"1","key":"e_1_3_1_27_2","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1080\/1463922X.2021.1879308","article-title":"Degraded situation awareness in a robotic workspace: Accident report analysis","volume":"23","author":"Camblor Benjamin","year":"2022","unstructured":"Benjamin Camblor, Jean-Marc Salotti, Charles Fage, and David Daney. 2022. Degraded situation awareness in a robotic workspace: Accident report analysis. Theor. Iss. Ergon. Sci. 23, 1 (2022), 60\u201379.","journal-title":"Theor. Iss. Ergon. Sci."},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/2593929.2593942"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1177\/0278364915627291"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCC.2010.2056682"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2016.2608826"},{"key":"e_1_3_1_32_2","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1145\/3365438.3410952","volume-title":"Proceedings of the 23rd ACM\/IEEE International Conference on Model Driven Engineering Languages and Systems","author":"Cheng Betty H. C.","year":"2020","unstructured":"Betty H. C. Cheng, Robert Jared Clark, Jonathon Emil Fleck, Michael Austin Langford, and Philip K. McKinley. 2020. AC-ROS: Assurance case driven adaptation for the robot operating system. In Proceedings of the 23rd ACM\/IEEE International Conference on Model Driven Engineering Languages and Systems. 102\u2013113."},{"key":"e_1_3_1_33_2","first-page":"12","volume-title":"Proceedings of the 2nd International Conference on AI Engineering \u2013 Software Engineering for AI","author":"Chowdhury Muhammed Tawfiq","year":"2023","unstructured":"Muhammed Tawfiq Chowdhury and Jane Cleland-Huang. 2023. Engineering challenges for AI-supported computer vision in small uncrewed aerial systems. In Proceedings of the 2nd International Conference on AI Engineering \u2013 Software Engineering for AI. IEEE, 12 pages."},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3382025.3414950"},{"key":"e_1_3_1_35_2","first-page":"120","volume-title":"Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems","author":"Cleland-Huang Jane","year":"2022","unstructured":"Jane Cleland-Huang, Ankit Agrawal, Michael Vierhauser, Michael Murphy, and Mike Prieto. 2022. Extending MAPE-K to support Human\u2013machine Teaming. In Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 120\u2013131. Retrieved from https:\/\/ieeexplore.ieee.org\/document\/9800015"},{"key":"e_1_3_1_36_2","article-title":"MROS: Runtime adaptation for robot control architectures","author":"Corbato Carlos Hernandez","year":"2020","unstructured":"Carlos Hernandez Corbato, Darko Bozhinoski, Mario Garzon Oviedo, Gijs van der Hoorn, Nadia Hammoudeh Garcia, Harshavardhan Deshpande, Jon Tjerngren, and Andrzej Wasowski. 2020. MROS: Runtime adaptation for robot control architectures. arXiv:2010.09145 (2020).","journal-title":"arXiv:2010.09145"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2853560"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3387939.3391597"},{"key":"e_1_3_1_39_2","first-page":"1","volume-title":"Proceedings of the International Conference on Computer Safety, Reliability, and Security","author":"Denney Ewen","year":"2012","unstructured":"Ewen Denney and Ganesh Pai. 2012. A lightweight methodology for safety case assembly. In Proceedings of the International Conference on Computer Safety, Reliability, and Security. Springer, 1\u201312."},{"key":"e_1_3_1_40_2","first-page":"587","volume-title":"Proceedings of the 37th IEEE International Conference on Software Engineering","volume":"2","author":"Denney Ewen","year":"2015","unstructured":"Ewen Denney, Ganesh Pai, and Ibrahim Habli. 2015. Dynamic safety cases for through-life safety assurance. In Proceedings of the 37th IEEE International Conference on Software Engineering, Vol. 2. IEEE, 587\u2013590."},{"key":"e_1_3_1_41_2","first-page":"199","volume-title":"Proceedings of the 17th International Conference on Engineering of Complex Computer Systems","author":"Denney Ewen","year":"2012","unstructured":"Ewen Denney, Ganesh Pai, and Josef Pohl. 2012. Heterogeneous aviation safety cases: Integrating the formal and the non-formal. In Proceedings of the 17th International Conference on Engineering of Complex Computer Systems. IEEE, 199\u2013208."},{"key":"e_1_3_1_42_2","first-page":"139","volume-title":"Proceedings of the USENIX Technical Conference","author":"Ding Rui","year":"2015","unstructured":"Rui Ding, Hucheng Zhou, Jian-Guang Lou, Hongyu Zhang, Qingwei Lin, Qiang Fu, Dongmei Zhang, and Tao Xie. 2015. Log2: A cost-aware logging mechanism for performance diagnosis. In Proceedings of the USENIX Technical Conference. 139\u2013150."},{"key":"e_1_3_1_43_2","article-title":"Research Incubator and Dataset","year":"2020","unstructured":"Dronology. 2020. Research Incubator and Dataset. Retrieved from https:\/\/dronology.info","journal-title":"R"},{"key":"e_1_3_1_44_2","first-page":"83","volume-title":"Management Science Models and Techniques","author":"Emery F. E.","year":"1960","unstructured":"F. E. Emery and E. L. Trist. 1960. Socio-technical systems. In Management Science Models and Techniques, Vol. 9, C. W. Churchman and M. Verhulst (Eds.). Pergamon, 83\u201397."},{"key":"e_1_3_1_45_2","volume-title":"Designing for Situation Awareness: An Approach to User-centered Design (2nd ed.)","author":"Endsley Mica R.","year":"2011","unstructured":"Mica R. Endsley. 2011. Designing for Situation Awareness: An Approach to User-centered Design (2nd ed.). CRC Press, Inc., Boca Raton, FL."},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1177\/1555343417695197"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/2856035"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2013.12.010"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2015.2421318"},{"issue":"8","key":"e_1_3_1_50_2","article-title":"In-the-loop or on-the-loop? Interactional arrangements to support team coordination with a planning agent","volume":"33","author":"Fischer Joel E.","year":"2021","unstructured":"Joel E. Fischer, Chris Greenhalgh, Wenchao Jiang, Sarvapali D. Ramchurn, Feng Wu, and Tom Rodden. 2021. In-the-loop or on-the-loop? Interactional arrangements to support team coordination with a planning agent. Concurr. Comput.: Pract. Exper. 33, 8 (2021), e4082.","journal-title":"Concurr. Comput.: Pract. Exper."},{"key":"e_1_3_1_51_2","article-title":"Preliminary Report B737-800MAX","author":"Foundation Flight Safety","year":"2019","unstructured":"Flight Safety Foundation. 2019. Preliminary Report B737-800MAX. Retrieved from https:\/\/flightsafety.org\/preliminary-report-b737-800max-et-avj","journal-title":"R"},{"key":"e_1_3_1_52_2","first-page":"1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems","author":"Fridman Lex","year":"2018","unstructured":"Lex Fridman, Bryan Reimer, Bruce Mehler, and William T. Freeman. 2018. Cognitive load estimation in the wild. In Proceedings of the CHI Conference on Human Factors in Computing Systems. ACM, New York, 1\u20139."},{"key":"e_1_3_1_53_2","doi-asserted-by":"crossref","unstructured":"Hargyo T. N Ignatius and Rami Bahsoon. 2021. A conceptual reference model for human as a service provider in cyber physical systems. International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS\u201921). IEEE.","DOI":"10.1109\/SEAMS51251.2021.00012"},{"issue":"3","key":"e_1_3_1_54_2","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1007\/s11571-019-09521-4","article-title":"A cognitive brain\u2013computer interface monitoring sustained attentional variations during a continuous task","volume":"13","author":"Gaume Antoine","year":"2019","unstructured":"Antoine Gaume, G\u00e9rard Dreyfus, and Fran\u00e7ois-Beno\u00eet Vialatte. 2019. A cognitive brain\u2013computer interface monitoring sustained attentional variations during a continuous task. Cognit. Neurodyn. 13, 3 (2019), 257\u2013269.","journal-title":"Cognit. Neurodyn."},{"key":"e_1_3_1_55_2","first-page":"32","volume-title":"Proceedings of the 14th International Symposium on Software Engineering for Adaptive and Self-managing Systems","author":"Gerostathopoulos Ilias","year":"2019","unstructured":"Ilias Gerostathopoulos and Evangelos Pournaras. 2019. TRAPPed in traffic? A self-adaptive framework for decentralized traffic optimization. In Proceedings of the 14th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 32\u201338."},{"key":"e_1_3_1_56_2","doi-asserted-by":"crossref","unstructured":"Holger Giese Nelly Bencomo Liliana Pasquale Andres Ramirez Paola Inverardi Sebastian W\u00e4tzoldt and Siobh\u00e1n Clarke. 2014. Living with uncertainty in the age of runtime models. Models@run.time: Foundations Applications and Roadmaps. Lecture Notes in Computer Science Vol. 8378. Springer Cham 47\u2013100. DOI:10.1007\/978-3-319- 116108915-7_3","DOI":"10.1007\/978-3-319-08915-7_3"},{"key":"e_1_3_1_57_2","first-page":"951","volume-title":"Proceedings of the International Conference on Unmanned Aircraft Systems","author":"H\u00e4gele Georg","year":"2017","unstructured":"Georg H\u00e4gele and Dirk S\u00f6ffker. 2017. A simplified situational environment risk and system reliability assessment for behavior assurance of autonomous and semi-autonomous aerial systems: A simulation study. In Proceedings of the International Conference on Unmanned Aircraft Systems. IEEE, 951\u2013960."},{"key":"e_1_3_1_58_2","unstructured":"Sandra G. Hart. 1986. NASA task load index (TLX) V1.0. NASA Human Performance Research Group (1986). https:\/\/ntrs.nasa.gov\/citations\/20000021487hhttps:\/\/ntrs.nasa.gov\/api\/citations\/20000021487\/downloads\/20000021487.pdf"},{"key":"e_1_3_1_59_2","article-title":"A model-based architecture for interactive run-time monitoring","author":"Hili Nicolas","year":"2020","unstructured":"Nicolas Hili, Mojtaba Bagherzadeh, Karim Jahed, and Juergen Dingel. 2020. A model-based architecture for interactive run-time monitoring. Softw. Syst. Model. 19 (2020), 959\u2013981.","journal-title":"Softw. Syst. Model."},{"key":"e_1_3_1_60_2","unstructured":"Barbara Christine Hoekenga. 2007. Mind Over Machine: What Deep Blue Taught us About Chess Artificial Intelligence and the Human Spirit. Dissertation Massachusetts Institute of Technology. https:\/\/dspace.mit.edu\/handle\/1721.1\/42144"},{"key":"e_1_3_1_61_2","doi-asserted-by":"crossref","unstructured":"Chao Huang Hailong Huang Junzhi Zhang Peng Hang Zhongxu Hu and Chen Lv. 2021. Humanmachine cooperative trajectory planning and tracking for safe automated driving. IIEEE Transactions on Intelligent Transportation Systems 23 8 (2021) 12050\u201312063.","DOI":"10.1109\/TITS.2021.3109596"},{"key":"e_1_3_1_62_2","first-page":"76","volume-title":"Proceedings of the 12th International Symposium on Software Engineering for Adaptive and Self-managing Systems","author":"Iftikhar Muhammad Usman","year":"2017","unstructured":"Muhammad Usman Iftikhar, Gowri Sankar Ramachandran, Pablo Bollans\u00e9e, Danny Weyns, and Danny Hughes. 2017. DeltaIoT: A self-adaptive internet of things exemplar. In Proceedings of the 12th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 76\u201382."},{"key":"e_1_3_1_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/2724719"},{"key":"e_1_3_1_64_2","first-page":"1","volume-title":"Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems (SEAMS\u201921)","author":"Ignatius Hargyo T. N.","year":"2021","unstructured":"Hargyo T. N. Ignatius and Rami Bahsoon. 2021. A conceptual reference model for human as a service provider in cyber physical systems. In Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems (SEAMS\u201921). IEEE, 1\u201310."},{"key":"e_1_3_1_65_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2022.111543"},{"key":"e_1_3_1_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/RE54965.2022.00020"},{"key":"e_1_3_1_67_2","article-title":"Situation Awareness\u2013based Agent Transparency","author":"Chen J. Y.","year":"2014","unstructured":"J. Y. Chen, K. Procci, M. Boyce, J. Wright, A. Garcia, and M. Barnes.2014. Situation Awareness\u2013based Agent Transparency. Report No. ARL-TR-6905. Aberdeen Proving Ground, MD: U.S. Army Research Laboratory.","journal-title":"Report No. ARL-TR-6905. Aberdeen Proving Ground, MD: U.S. Army Research Laboratory."},{"key":"e_1_3_1_68_2","first-page":"146","volume-title":"Proceedings of the 4th International Workshops on Foundations and Applications of Self* Systems","author":"Jahan Sharmin","year":"2019","unstructured":"Sharmin Jahan, Matthew Pasco, Rose Gamble, Philip McKinley, and Betty Cheng. 2019. MAPE-SAC: A framework to dynamically manage security assurance cases. In Proceedings of the 4th International Workshops on Foundations and Applications of Self* Systems. IEEE, 146\u2013151."},{"key":"e_1_3_1_69_2","first-page":"39","volume-title":"Proceedings of the 14th International Symposium on Software Engineering for Adaptive and Self-managing Systems","author":"Jamshidi Pooyan","year":"2019","unstructured":"Pooyan Jamshidi, Javier C\u00e1mara, Bradley Schmerl, Christian K\u00e4estner, and David Garlan. 2019. Machine learning meets quantitative planning: Enabling self-adaptation in autonomous robots. In Proceedings of the 14th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 39\u201350."},{"key":"e_1_3_1_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2866403"},{"key":"e_1_3_1_71_2","doi-asserted-by":"publisher","DOI":"10.1080\/00207543.2020.1722324"},{"key":"e_1_3_1_72_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00766-014-0204-0"},{"key":"e_1_3_1_73_2","volume-title":"Concepts and Principles of Compositional Safety Cases","author":"Kelly T. P.","year":"2001","unstructured":"T. P. Kelly. 2001. Concepts and Principles of Compositional Safety Cases, COMSA\/2001\/1\/1. Technical Report, University of York, York."},{"key":"e_1_3_1_74_2","volume-title":"Proceedings of the 15th International Symposium on Software Engineering for Adaptive and Self-managing Systems","author":"Kephart Jeffrey","year":"2020","unstructured":"Jeffrey Kephart. 2020. Keynote: Viewing autonomic computing through the lens of embodied artificial intelligence: A self-debate. In Proceedings of the 15th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE."},{"key":"e_1_3_1_75_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2003.1160055"},{"key":"e_1_3_1_76_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2004.74"},{"key":"e_1_3_1_77_2","volume-title":"The Overflowing Brain: Information Overload and the Limits of Working Memory","author":"Klingberg Torkel","year":"2009","unstructured":"Torkel Klingberg. 2009. The Overflowing Brain: Information Overload and the Limits of Working Memory. Oxford University Press."},{"key":"e_1_3_1_78_2","unstructured":"Margarita Konaev and Husanjot Chahal. 2021. Building trust in human\u2013machine teams. Retrieved from https:\/\/www.brookings.edu\/techstream\/building-trust-in-human-machine-teams"},{"key":"e_1_3_1_79_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12008-014-0227-2"},{"key":"e_1_3_1_80_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.2020.3041231"},{"key":"e_1_3_1_81_2","volume-title":"The Use of Safety Cases in Certification and Regulation","author":"Leveson Nancy G.","year":"2011","unstructured":"Nancy G. Leveson. 2011. The Use of Safety Cases in Certification and Regulation. Technical Report. MIT."},{"key":"e_1_3_1_82_2","first-page":"181","volume-title":"Proceedings of the IEEE\/ACM 15th International Symposium on Software Engineering for Adaptive and Self-managing Systems","author":"Li Nianyu","year":"2020","unstructured":"Nianyu Li, Sridhar Adepu, Eunsuk Kang, and David Garlan. 2020. Explanations for human-on-the-loop: A probabilistic model checking approach. In Proceedings of the IEEE\/ACM 15th International Symposium on Software Engineering for Adaptive and Self-managing Systems. ACM, New York, 181\u2013187."},{"key":"e_1_3_1_83_2","doi-asserted-by":"publisher","DOI":"10.1109\/SEAMS51251.2021.00017"},{"key":"e_1_3_1_84_2","doi-asserted-by":"publisher","DOI":"10.3390\/robotics10010012"},{"key":"e_1_3_1_85_2","doi-asserted-by":"publisher","DOI":"10.1109\/SEAMS.2017.1"},{"key":"e_1_3_1_86_2","doi-asserted-by":"publisher","DOI":"10.1109\/MAES.2009.4772749"},{"key":"e_1_3_1_87_2","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/B978-0-12-817636-8.00006-5","volume-title":"Artificial Intelligence for the Internet of Everything","author":"Lyons Joseph B.","year":"2019","unstructured":"Joseph B. Lyons, Kevin T. Wynne, Sean Mahoney, and Mark A. Roebke. 2019. Trust and human\u2013machine teaming: A qualitative study. In Artificial Intelligence for the Internet of Everything. Elsevier, 101\u2013116."},{"key":"e_1_3_1_88_2","doi-asserted-by":"publisher","DOI":"10.3390\/systems6040044"},{"key":"e_1_3_1_89_2","doi-asserted-by":"publisher","DOI":"10.1145\/38765.38821"},{"key":"e_1_3_1_90_2","first-page":"107","volume-title":"Proceedings of the 14th International Symposium on Software Engineering for Adaptive and Self-managing Systems","author":"Maia Paulo Henrique","year":"2019","unstructured":"Paulo Henrique Maia, Lucas Vieira, Matheus Chagas, Yijun Yu, Andrea Zisman, and Bashar Nuseibeh. 2019. Dragonfly: A tool for simulating self-adaptive drone behaviours. In Proceedings of the 14th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 107\u2013113."},{"key":"e_1_3_1_91_2","first-page":"1","volume-title":"Proceedings of the 11th International Conference on Control","author":"McAree Owen","year":"2016","unstructured":"Owen McAree, Jonathan M. Aitken, and Sandor M. Veres. 2016. A model based design framework for safety verification of a semi-autonomous inspection drone. In Proceedings of the 11th International Conference on Control. IEEE, 1\u20136."},{"key":"e_1_3_1_92_2","unstructured":"Patricia McDermott Cindy Dominguez Nicholas Kasdaglis Matthew Ryan and Isabel Trahan. 2018. Human-machine Teaming Systems Engineering Guide. Technical report # MP180941 Mitre Corp. Bedford Bedford MA."},{"key":"e_1_3_1_93_2","article-title":"Quenching the Thirst for Human\u2013machine Teaming Guidance: Helping Military Systems Acquisition Leverage Cognitive Engineering Research. The MITRE Corporation","author":"McDermott Patricia L.","year":"2018","unstructured":"Patricia L. McDermott, Katherine E. Walker, Cynthia O. Dominguez, Alex Nelson, and Nicholas Kasdaglis. 2018. Quenching the Thirst for Human\u2013machine Teaming Guidance: Helping Military Systems Acquisition Leverage Cognitive Engineering Research. The MITRE Corporation. Retrieved from https:\/\/www.mitre.org\/publications\/technical-papers\/quenching-the-thirst-for-human-machine-teaming-guidance-helping","journal-title":"R"},{"key":"e_1_3_1_94_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICNSURV.2019.8735205"},{"key":"e_1_3_1_95_2","first-page":"181","volume-title":"Proceedings of the 14th International Symposium on Software Engineering for Adaptive and Self-managing Systems","author":"Moreno Gabriel","year":"2019","unstructured":"Gabriel Moreno, Cody Kinneer, Ashutosh Pandey, and David Garlan. 2019. DARTSim: An exemplar for evaluation and comparison of self-adaptation approaches for smart cyber-physical systems. In Proceedings of the 14th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 181\u2013187."},{"key":"e_1_3_1_96_2","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1007\/978-3-030-00761-4_5","volume-title":"Proceedings of the European Conference on Software Architecture","author":"Muccini Henry","year":"2018","unstructured":"Henry Muccini and Mahyar Tourchi Moghaddam. 2018. IOT architectural styles. In Proceedings of the European Conference on Software Architecture. Springer, 68\u201385."},{"key":"e_1_3_1_97_2","doi-asserted-by":"publisher","DOI":"10.1145\/1806672.1806682"},{"key":"e_1_3_1_98_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2018.2830647"},{"issue":"1","key":"e_1_3_1_99_2","doi-asserted-by":"crossref","first-page":"25","DOI":"10.3311\/pp.me.2008-1.05","article-title":"Human weaknesses and strengths in collaboration with robots","volume":"52","author":"Ogorodnikova Olessia","year":"2008","unstructured":"Olessia Ogorodnikova. 2008. Human weaknesses and strengths in collaboration with robots. Period. Polytech. Mechan. Eng. 52, 1 (2008), 25\u201333.","journal-title":"Period. Polytech. Mechan. Eng."},{"key":"e_1_3_1_100_2","first-page":"141","volume-title":"Proceedings of the Symposium on Eye-tracking Research & Applications","author":"Palinko Oskar","year":"2010","unstructured":"Oskar Palinko, Andrew L. Kun, Alexander Shyrokov, and Peter Heeman. 2010. Estimating cognitive load using remote eye tracking in a driving simulator. In Proceedings of the Symposium on Eye-tracking Research & Applications. ACM, New York, 141\u2013144."},{"key":"e_1_3_1_101_2","doi-asserted-by":"publisher","DOI":"10.1177\/1555343419881563"},{"key":"e_1_3_1_102_2","volume-title":"Proceedings of the 25th International Conference on Model Driven Engineering Languages and Systems","author":"Parra-Ullauri Juan","year":"2022","unstructured":"Juan Parra-Ullauri, Antonio Garcia-Dominguez, Nelly Bencomo, and Luis Garcia-Paucar. 2022. History-aware explanations: Towards enabling human-in-the-loop in self-adaptive systems. In Proceedings of the 25th International Conference on Model Driven Engineering Languages and Systems. ACM. Retrieved from http:\/\/dro.dur.ac.uk\/37030\/"},{"key":"e_1_3_1_103_2","doi-asserted-by":"publisher","DOI":"10.1109\/SEAMS.2019.00013"},{"key":"e_1_3_1_104_2","doi-asserted-by":"publisher","DOI":"10.1109\/RE.2010.22"},{"issue":"3","key":"e_1_3_1_105_2","article-title":"Confidence and certainty: Distinct probabilistic quantities for different goals","volume":"19","author":"Pouget Alexandre","year":"2016","unstructured":"Alexandre Pouget, Jan Drugowitsch, and Adam Kepecs. 2016. Confidence and certainty: Distinct probabilistic quantities for different goals. Nat. Neurosci. 19, 3 (2016), 366.","journal-title":"Nat. Neurosci."},{"key":"e_1_3_1_106_2","first-page":"41","volume-title":"Proceedings of the 1st International Workshop on Requirements@Run.Time","author":"Ramirez Andres J.","year":"2010","unstructured":"Andres J. Ramirez, Betty H. C. Cheng, and Philip K. McKinley. 2010. Adaptive monitoring of software requirements. In Proceedings of the 1st International Workshop on Requirements@Run.Time. IEEE, 41\u201350."},{"key":"e_1_3_1_107_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2014.2307258"},{"issue":"1","key":"e_1_3_1_108_2","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1177\/1359105309346343","article-title":"Perceived stress scale","volume":"15","author":"Reis R. Siqueira","year":"2010","unstructured":"R. Siqueira Reis, A. A. Hino, and C. R. A\u00f1ez. 2010. Perceived stress scale. J. Health Psychol. 15, 1 (2010), 107\u2013114.","journal-title":"J. Health Psychol."},{"key":"e_1_3_1_109_2","doi-asserted-by":"publisher","DOI":"10.1145\/3417990.3419503"},{"key":"e_1_3_1_110_2","doi-asserted-by":"publisher","DOI":"10.1145\/3419804.3420262"},{"key":"e_1_3_1_111_2","doi-asserted-by":"publisher","DOI":"10.1177\/1555343419842776"},{"key":"e_1_3_1_112_2","doi-asserted-by":"publisher","DOI":"10.1142\/S0218194003001378"},{"key":"e_1_3_1_113_2","doi-asserted-by":"publisher","DOI":"10.5555\/2821357.2821361"},{"key":"e_1_3_1_114_2","doi-asserted-by":"crossref","unstructured":"Lucas Sakizloglou Sona Ghahremani Matthias Barkowsky and Holger Giese. 2022. Incremental execution of temporal graph queries over runtime models with history and its applications. Software and Systems Modeling 21 5 (2022) 1789\u20131829.","DOI":"10.1007\/s10270-021-00950-6"},{"key":"e_1_3_1_115_2","doi-asserted-by":"publisher","DOI":"10.1145\/3387939.3388614"},{"key":"e_1_3_1_116_2","volume-title":"Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems","author":"Sinha Md Nafee Al Islam, Jane Cleland-Huang, Myra Cohen, Salil Purandare, and Urjoshi","year":"2023","unstructured":"Md Nafee Al Islam, Jane Cleland-Huang, Myra Cohen, Salil Purandare, and Urjoshi Sinha. 2023. Self-adaptive mechanisms for misconfigurations in small uncrewed aerial systems. In Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems."},{"key":"e_1_3_1_117_2","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1007\/978-3-030-51924-7_6","volume-title":"Explainable, Transparent Autonomous Agents and Multi-Agent Systems","author":"Sanneman Lindsay","year":"2020","unstructured":"Lindsay Sanneman and Julie A. Shah. 2020. A situation awareness-based framework for design and evaluation of explainable AI. In Explainable, Transparent Autonomous Agents and Multi-Agent Systems. Springer International Publishing, Cham, 94\u2013110."},{"key":"e_1_3_1_118_2","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2018.00015"},{"key":"e_1_3_1_119_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10111-019-00548-5"},{"key":"e_1_3_1_120_2","volume-title":"Proceedings of the 24th Americas Conference on Information Systems","author":"Sherif Karma","year":"2018","unstructured":"Karma Sherif and Omolola Jewisimi. 2018. Electronic performance monitoring friend or foe: Empowering employees through data analytics. In Proceedings of the 24th Americas Conference on Information Systems. Association for Information Systems. Retrieved from https:\/\/aisel.aisnet.org\/amcis2018\/CultureIS\/Presentations\/7"},{"key":"e_1_3_1_121_2","doi-asserted-by":"publisher","DOI":"10.1109\/WCSP.2011.6096958"},{"issue":"3","key":"e_1_3_1_122_2","article-title":"The state-trait anxiety inventory","volume":"5","author":"Spielberger Charles D.","year":"1971","unstructured":"Charles D. Spielberger, Fernando Gonzalez-Reigosa, Angel Martinez-Urrutia, Luiz F. S. Natalicio, and Diana S. Natalicio. 1971. The state-trait anxiety inventory. Revist. Interamer. Psicol.\/Interamer. J. Psychol. 5, 3 & 4 (1971).","journal-title":"Revist. Interamer. Psicol.\/Interamer. J. Psychol."},{"key":"e_1_3_1_123_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-44902-9_13"},{"key":"e_1_3_1_124_2","doi-asserted-by":"publisher","DOI":"10.1109\/32.738340"},{"key":"e_1_3_1_125_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICAC.2017.25"},{"key":"e_1_3_1_126_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2019.2907595"},{"key":"e_1_3_1_127_2","first-page":"73","volume-title":"Proceedings of the 44th Euromicro Conference on Software Engineering and Advanced Applications","author":"Vierhauser Michael","year":"2018","unstructured":"Michael Vierhauser, Jane Cleland-Huang, Sean Bayley, Thomas Krismayer, Rick Rabiser, and Pau Gr\u00fcnbacher. 2018. Monitoring CPS at runtime\u2014A case study in the UAV domain. In Proceedings of the 44th Euromicro Conference on Software Engineering and Advanced Applications. IEEE, 73\u201380."},{"key":"e_1_3_1_128_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468264.3468534"},{"key":"e_1_3_1_129_2","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1007\/978-3-642-35813-5_11","volume-title":"Software Engineering for Self-Adaptive Systems II: International Seminar, Dagstuhl Castle, Germany, October 24\u201329, 2010 Revised Selected and Invited Papers","author":"Villegas Norha M.","year":"2013","unstructured":"Norha M. Villegas, Gabriel Tamura, Hausi A. M\u00fcller, Laurence Duchien, and Rubby Casallas. 2013. DYNAMICO: A reference model for governing control objectives and context relevance in self-adaptive software systems. In Software Engineering for Self-Adaptive Systems II: International Seminar, Dagstuhl Castle, Germany, October 24\u201329, 2010 Revised Selected and Invited Papers. Springer, 265\u2013293."},{"key":"e_1_3_1_130_2","first-page":"129","volume-title":"Proceedings of the 7th International Symposium on Software Engineering for Adaptive and Self-managing Systems","author":"Vogel Thomas","year":"2012","unstructured":"Thomas Vogel and Holger Giese. 2012. A language for feedback loops in self-adaptive systems: Executable runtime megamodels. In Proceedings of the 7th International Symposium on Software Engineering for Adaptive and Self-managing Systems. IEEE, 129\u2013138."},{"key":"e_1_3_1_131_2","first-page":"224","volume-title":"Proceedings of the International Conference on Model Driven Engineering Languages and Systems","author":"Vogel Thomas","year":"2010","unstructured":"Thomas Vogel, Andreas Seibel, and Holger Giese. 2010. The role of models and megamodels at runtime. In Proceedings of the International Conference on Model Driven Engineering Languages and Systems. Springer, 224\u2013238."},{"key":"e_1_3_1_132_2","doi-asserted-by":"publisher","DOI":"10.1080\/14639220701635470"},{"key":"e_1_3_1_133_2","first-page":"111","volume-title":"Proceedings of the 11th International Conference on Self-adaptive and Self-organizing Systems","author":"Wei\u00dfbach Martin","year":"2017","unstructured":"Martin Wei\u00dfbach, Philipp Chrszon, Thomas Springer, and Alexander Schill. 2017. Decentrally coordinated execution of adaptations in distributed self-adaptive software systems. In Proceedings of the 11th International Conference on Self-adaptive and Self-organizing Systems. IEEE, 111\u2013120."},{"key":"e_1_3_1_134_2","doi-asserted-by":"publisher","DOI":"10.1145\/2489850.2489860"},{"key":"e_1_3_1_135_2","doi-asserted-by":"publisher","DOI":"10.1177\/1729881417710463"},{"key":"e_1_3_1_136_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-64107-2_22"},{"key":"e_1_3_1_137_2","first-page":"30","volume-title":"Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems (SEAMS\u201921)","author":"Yigitbas Enes","year":"2021","unstructured":"Enes Yigitbas, Kadiray Karakaya, Ivan Jovanovikj, and Gregor Engels. 2021. Enhancing human-in-the-loop adaptive systems through digital twins and VR interfaces. In Proceedings of the International Symposium on Software Engineering for Adaptive and Self-managing Systems (SEAMS\u201921). IEEE, 30\u201340."},{"key":"e_1_3_1_138_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2942033"},{"key":"e_1_3_1_139_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359158"}],"container-title":["ACM Transactions on Autonomous and Adaptive Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3618001","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3618001","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:58Z","timestamp":1750178278000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3618001"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,14]]},"references-count":138,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,3,31]]}},"alternative-id":["10.1145\/3618001"],"URL":"https:\/\/doi.org\/10.1145\/3618001","relation":{},"ISSN":["1556-4665","1556-4703"],"issn-type":[{"value":"1556-4665","type":"print"},{"value":"1556-4703","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,14]]},"assertion":[{"value":"2022-10-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-08-23","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-02-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}