{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T01:46:17Z","timestamp":1787017577798,"version":"build-2736575974"},"publisher-location":"New York, NY, USA","reference-count":75,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,9,22]],"date-time":"2024-09-22T00:00:00Z","timestamp":1726963200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"ARC Laureate Fellowship","award":["FL190100035"],"award-info":[{"award-number":["FL190100035"]}]},{"name":"Faculty of IT Post-graduate scholarship"},{"name":"ARC Discovery Project","award":["DP200100020"],"award-info":[{"award-number":["DP200100020"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,9,22]]},"DOI":"10.1145\/3640310.3674092","type":"proceedings-article","created":{"date-parts":[[2024,9,30]],"date-time":"2024-09-30T13:38:07Z","timestamp":1727703487000},"page":"195-202","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Towards Runtime Monitoring for Responsible Machine Learning using Model-driven Engineering"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0045-4577","authenticated-orcid":false,"given":"Hira","family":"Naveed","sequence":"first","affiliation":[{"name":"Monash University, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4928-7076","authenticated-orcid":false,"given":"John","family":"Grundy","sequence":"additional","affiliation":[{"name":"Monash University, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1466-7386","authenticated-orcid":false,"given":"Chetan","family":"Arora","sequence":"additional","affiliation":[{"name":"Monash University, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9958-0102","authenticated-orcid":false,"given":"Hourieh","family":"Khalajzadeh","sequence":"additional","affiliation":[{"name":"Deakin University, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2346-3131","authenticated-orcid":false,"given":"Omar","family":"Haggag","sequence":"additional","affiliation":[{"name":"Monash University, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,9,22]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"[n. d.]. Adult dataset. https:\/\/archive.ics.uci.edu\/ml\/datasets\/Adult"},{"key":"e_1_3_2_1_2_1","unstructured":"[n. d.]. The AI Observability & LLM Evaluation Platform. https:\/\/arize.com\/"},{"key":"e_1_3_2_1_3_1","unstructured":"[n.d.]. Australia's AI Ethics Principles. https:\/\/www.industry.gov.au\/publications\/australias-artificial-intelligence-ethics-framework\/australias-aiethics-principles"},{"key":"e_1_3_2_1_4_1","unstructured":"[n. d.]. Ethics guidelines for trustworthy AI. https:\/\/digital-strategy.ec.europa.eu\/en\/library\/ethics-guidelines-trustworthy-ai"},{"key":"e_1_3_2_1_5_1","unstructured":"[n. d.]. Future of ai technologies report. https:\/\/www.gartner.com\/smarterwithgartner\/gartner-predictsthe-future-of-ai-technologies"},{"key":"e_1_3_2_1_6_1","unstructured":"[n.d.]. IBM Watson Openscale. https:\/\/www.ibm.com\/docs\/en\/cloud-paks\/cpdata\/3.5.0?topic=services-watson-openscale"},{"key":"e_1_3_2_1_7_1","unstructured":"[n.d.]. Introduction to Vertex AI Model Monitoring. https:\/\/cloud.google.com\/vertex-ai\/docs\/model-monitoring\/overview"},{"key":"e_1_3_2_1_8_1","unstructured":"[n. d.]. Model monitoring with Azure Machine Learning. https:\/\/learn.microsoft.com\/en-us\/azure\/machine-learning\/concept-model-monitoring?view=azureml-api-2"},{"key":"e_1_3_2_1_9_1","unstructured":"[n.d.]. Monitor data and model quality. https:\/\/docs.aws.amazon.com\/sagemaker\/latest\/dg\/model-monitor.html"},{"key":"e_1_3_2_1_10_1","unstructured":"[n. d.]. The open-source ML observability platform. https:\/\/www.evidentlyai.com\/"},{"key":"e_1_3_2_1_11_1","unstructured":"[n. d.]. Principles for the Ethical Use of AI in the UN System. https:\/\/unsceb.org\/principles- ethical- use- artificial-intelligence-united-nations-system"},{"key":"e_1_3_2_1_12_1","volume-title":"Requirements engineering for artificial intelligence systems: A systematic mapping study. Information and Software Technology","author":"Ahmad Khlood","year":"2023","unstructured":"Khlood Ahmad, Mohamed Abdelrazek, Chetan Arora, Muneera Bano, and John Grundy. 2023. Requirements engineering for artificial intelligence systems: A systematic mapping study. Information and Software Technology (2023), 107176."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287588"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58920-2_13"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2019.2942287"},{"key":"e_1_3_2_1_16_1","unstructured":"Thomas Brand and Holger Giese. 2018. Towards software architecture runtime models for continuous adaptive monitoring.. In MoDELS (Workshops). 72--77."},{"key":"e_1_3_2_1_17_1","volume-title":"Chatbots: changing user needs and motivations. interactions 25, 5","author":"Brandtzaeg Petter Bae","year":"2018","unstructured":"Petter Bae Brandtzaeg and Asbj\u00f8rn F\u00f8lstad. 2018. Chatbots: changing user needs and motivations. interactions 25, 5 (2018), 38--43."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377816.3381734"},{"key":"e_1_3_2_1_19_1","volume-title":"d.]. Responsible AI. https:\/\/www.csiro.au\/en\/work-with-us\/industries\/technology\/national-aicentre","author":"Australia's National Artificial Intelligence Centre. [n.","year":"2023","unstructured":"Australia's National Artificial Intelligence Centre. [n. d.]. Responsible AI. https:\/\/www.csiro.au\/en\/work-with-us\/industries\/technology\/national-aicentre, 2023.Accessed:November2023"},{"key":"e_1_3_2_1_20_1","volume-title":"International Conference on Machine Learning. PMLR, 4087--4111","author":"Cobb Oliver","year":"2022","unstructured":"Oliver Cobb and Arnaud Van Looveren. 2022. Context-aware drift detection. In International Conference on Machine Learning. PMLR, 4087--4111."},{"key":"e_1_3_2_1_21_1","unstructured":"CSIRO. 2023. Responsible AI Pattern Catalogue. https:\/\/www.csiro.au\/en\/research\/technology-space\/ai\/Responsible-AI\/RAI-Pattern-Catalogue"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3368089.3417919"},{"key":"e_1_3_2_1_23_1","volume-title":"Ethics of data and analytics","author":"Dastin Jeffrey","unstructured":"Jeffrey Dastin. 2022. Amazon scraps secret AI recruiting tool that showed bias against women. In Ethics of data and analytics. Auerbach Publications, 296--299."},{"key":"e_1_3_2_1_24_1","volume-title":"SHAPr: An efficient and versatile membership privacy risk metric for machine learning. arXiv preprint arXiv:2112.02230","author":"Duddu Vasisht","year":"2021","unstructured":"Vasisht Duddu, Sebastian Szyller, and N Asokan. 2021. SHAPr: An efficient and versatile membership privacy risk metric for machine learning. arXiv preprint arXiv:2112.02230 (2021)."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-27615-7_17"},{"key":"e_1_3_2_1_26_1","volume-title":"UML 2 toolkit","author":"Eriksson Hans-Erik","unstructured":"Hans-Erik Eriksson, Magnus Penker, Brian Lyons, and David Fado. 2003. UML 2 toolkit. John Wiley & Sons."},{"key":"e_1_3_2_1_27_1","volume-title":"Principled artificial intelligence","author":"Fjeld Jessica","year":"2020","unstructured":"Jessica Fjeld, Nele Achten, Hannah Hilligoss, A Nagy, and Madhulika Srikumar. 2020. Principled artificial intelligence. Berkman Klein Center, February 14 (2020)."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-005-0078-1"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514094.3534157"},{"key":"e_1_3_2_1_30_1","volume-title":"International Conference on Artificial Intelligence and Statistics. PMLR, 3962--3997","author":"Ginart Tony","year":"2022","unstructured":"Tony Ginart, Martin Jinye Zhang, and James Zou. 2022. Mldemon: Deployment monitoring for machine learning systems. In International Conference on Artificial Intelligence and Statistics. PMLR, 3962--3997."},{"key":"e_1_3_2_1_31_1","volume-title":"Anna Tselioudis Garmendia, and Karim Lekadir","author":"Gkontra Polyxeni","year":"2023","unstructured":"Polyxeni Gkontra, Gianluca Quaglio, Anna Tselioudis Garmendia, and Karim Lekadir. 2023. Challenges of Machine Learning and AI (What Is Next?), Responsible and Ethical AI. In Clinical Applications of Artificial Intelligence in Real-World Data. Springer, 263--285."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3361525.3361543"},{"key":"e_1_3_2_1_33_1","volume-title":"International Conference on Evaluation of Novel Approaches to Software Engineering. Springer, 444--468","author":"Grundy John","year":"2020","unstructured":"John Grundy, Hourieh Khalajzadeh, Jennifer McIntosh, Tanjila Kanij, and Ingo Mueller. 2020. Humanise: Approaches to achieve more human-centric software engineering. In International Conference on Evaluation of Novel Approaches to Software Engineering. Springer, 444--468."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE55969.2022.00047"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/s43681-022-00188-y"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-021-05993-w"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467177"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3594028"},{"key":"e_1_3_2_1_39_1","volume-title":"The global landscape of AI ethics guidelines. Nature machine intelligence 1, 9","author":"Jobin Anna","year":"2019","unstructured":"Anna Jobin, Marcello Ienca, and Effy Vayena. 2019. The global landscape of AI ethics guidelines. Nature machine intelligence 1, 9 (2019), 389--399."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3607199.3607232"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-022-01064-3"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"crossref","unstructured":"Dimitrios S Kolovos Richard F Paige and Fiona AC Polack. 2009. On the evolution of OCL for capturing structural constraints in modelling languages. Rigorous Methods for Software Construction and Analysis: Essays Dedicated to Egon B\u00f6rger on the Occasion of His 60th Birthday (2009) 204--218.","DOI":"10.1007\/978-3-642-11447-2_13"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/MODELS-C53483.2021.00028"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/MODELS-C59198.2023.00056"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-33383-0"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/MODELS50736.2021.00027"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.5381\/jot.2020.19.2.a6"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3526073.3527590"},{"key":"e_1_3_2_1_49_1","volume-title":"International Conference on Machine Learning. PMLR, 3150--3158","author":"Liu Lydia T","year":"2018","unstructured":"Lydia T Liu, Sarah Dean, Esther Rolf, Max Simchowitz, and Moritz Hardt. 2018. Delayed impact of fair machine learning. In International Conference on Machine Learning. PMLR, 3150--3158."},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3522664.3528607"},{"key":"e_1_3_2_1_51_1","volume-title":"Responsible ai pattern catalogue: A collection of best practices for ai governance and engineering. Comput. Surveys","author":"Lu Qinghua","year":"2023","unstructured":"Qinghua Lu, Liming Zhu, Xiwei Xu, Jon Whittle, Didar Zowghi, and Aurelie Jacquet. 2023. Responsible ai pattern catalogue: A collection of best practices for ai governance and engineering. Comput. Surveys (2023)."},{"key":"e_1_3_2_1_52_1","volume-title":"Large-scale machine learning systems in real-world industrial settings: A review of challenges and solutions. Information and software technology 127","author":"Lwakatare Lucy Ellen","year":"2020","unstructured":"Lucy Ellen Lwakatare, Aiswarya Raj, Ivica Crnkovic, Jan Bosch, and Helena Holmstr\u00f6m Olsson. 2020. Large-scale machine learning systems in real-world industrial settings: A review of challenges and solutions. Information and software technology 127 (2020), 106368."},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236024.3264833"},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3607199.3607224"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3510003.3510209"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"crossref","unstructured":"Hira Naveed. 2023. Runtime Monitoring of Human-Centric Requirements in Machine Learning Components: A Model-Driven Engineering Approach. In 2023 ACM\/IEEE International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C). IEEE 146--152.","DOI":"10.1109\/MODELS-C59198.2023.00040"},{"key":"e_1_3_2_1_57_1","volume-title":"Model driven engineering for machine learning components: A systematic literature review. Information and Software Technology","author":"Naveed Hira","year":"2024","unstructured":"Hira Naveed, Chetan Arora, Hourieh Khalajzadeh, John Grundy, and Omar Haggag. 2024. Model driven engineering for machine learning components: A systematic literature review. Information and Software Technology (2024), 107423."},{"key":"e_1_3_2_1_58_1","volume-title":"Beat Buesser, Ambrish Rawat, Martin Wistuba, Valentina Zantedeschi, Nathalie Baracaldo, Bryant Chen, Heiko Ludwig, et al.","author":"Nicolae Maria-Irina","year":"2018","unstructured":"Maria-Irina Nicolae, Mathieu Sinn, Minh Ngoc Tran, Beat Buesser, Ambrish Rawat, Martin Wistuba, Valentina Zantedeschi, Nathalie Baracaldo, Bryant Chen, Heiko Ludwig, et al. 2018. Adversarial Robustness Toolbox v1. 0.0. arXiv preprint arXiv:1807.01069 (2018)."},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3534678.3539145"},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-022-01807-1"},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-69100-6_1"},{"key":"e_1_3_2_1_62_1","volume-title":"AAAI Spring Symposium","author":"Roy Anirban","year":"2022","unstructured":"Anirban Roy, Adam Cobb, Nathaniel Bastian, Brian Jalaian, and Susmit Jha. 2022. Runtime monitoring of deep neural networks using top-down context models inspired by predictive processing and dual process theory. In AAAI Spring Symposium 2022."},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData55660.2022.10021121"},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dsm.2022.07.004"},{"key":"e_1_3_2_1_65_1","volume-title":"Workshop on Artificial Intelligence Safety 2020 (co-located with IJCAI-PRICAI","author":"Shao Zhihui","year":"2020","unstructured":"Zhihui Shao and Jianyi Yang. 2020. Increasing the Trustworthiness of Deep Neural Networks via Accuracy Monitoring. In Workshop on Artificial Intelligence Safety 2020 (co-located with IJCAI-PRICAI 2020)."},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1007\/s43681-022-00195-z"},{"key":"e_1_3_2_1_67_1","volume-title":"Merks, and Marcelo Paternostro","author":"Steinberg Dave","year":"2008","unstructured":"Dave Steinberg, Frank Budinsky, Ed Merks, and Marcelo Paternostro. 2008. EMF: eclipse modeling framework. Pearson Education."},{"key":"e_1_3_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377811.3380353"},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSPEC.2019.8678513"},{"key":"e_1_3_2_1_70_1","volume-title":"International Conference on Machine Learning. PMLR","author":"Sun Yiyou","year":"2022","unstructured":"Yiyou Sun, Yifei Ming, Xiaojin Zhu, and Yixuan Li. 2022. Out-of-distribution detection with deep nearest neighbors. In International Conference on Machine Learning. PMLR, 20827--20840."},{"key":"e_1_3_2_1_71_1","volume-title":"Runtime Monitors for Operational Design Domains of Black-Box ML-Models. In NeurIPS ML Safety Workshop.","author":"Torfah Hazem","unstructured":"Hazem Torfah and Sanjit A Seshia. [n. d.]. Runtime Monitors for Operational Design Domains of Black-Box ML-Models. In NeurIPS ML Safety Workshop."},{"key":"e_1_3_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2023.111733"},{"key":"e_1_3_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3580305.3599802"},{"key":"e_1_3_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3550355.3552401"},{"key":"e_1_3_2_1_75_1","volume-title":"AI and ethics---Operationalizing responsible AI. Humanity driven AI: Productivity, well-being, sustainability and partnership","author":"Zhu Liming","year":"2022","unstructured":"Liming Zhu, Xiwei Xu, Qinghua Lu, Guido Governatori, and Jon Whittle. 2022. AI and ethics---Operationalizing responsible AI. Humanity driven AI: Productivity, well-being, sustainability and partnership (2022), 15--33."}],"event":{"name":"MODELS '24: ACM\/IEEE 27th International Conference on Model Driven Engineering Languages and Systems","location":"Linz Austria","acronym":"MODELS '24","sponsor":["Johannes Kepler University, Linz, Austria","SIGSOFT ACM Special Interest Group on Software Engineering","IEEE CS"]},"container-title":["Proceedings of the ACM\/IEEE 27th International Conference on Model Driven Engineering Languages and Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3640310.3674092","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3640310.3674092","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T23:51:16Z","timestamp":1755906676000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3640310.3674092"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,22]]},"references-count":75,"alternative-id":["10.1145\/3640310.3674092","10.1145\/3640310"],"URL":"https:\/\/doi.org\/10.1145\/3640310.3674092","relation":{},"subject":[],"published":{"date-parts":[[2024,9,22]]},"assertion":[{"value":"2024-09-22","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}