{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,1]],"date-time":"2025-11-01T09:32:14Z","timestamp":1761989534075,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":20,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,10,16]],"date-time":"2020-10-16T00:00:00Z","timestamp":1602806400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"H2020 Marie Sk?odowska-Curie Actions","award":["813884"],"award-info":[{"award-number":["813884"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,10,16]]},"DOI":"10.1145\/3417990.3420196","type":"proceedings-article","created":{"date-parts":[[2020,11,2]],"date-time":"2020-11-02T14:03:18Z","timestamp":1604325798000},"page":"1-8","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Towards a low-code solution for monitoring machine learning model performance"],"prefix":"10.1145","author":[{"given":"Panagiotis","family":"Kourouklidis","sequence":"first","affiliation":[{"name":"University of York"}]},{"given":"Dimitris","family":"Kolovos","sequence":"additional","affiliation":[{"name":"University of York"}]},{"given":"Nicholas","family":"Matragkas","sequence":"additional","affiliation":[{"name":"University of York"}]},{"given":"Joost","family":"Noppen","sequence":"additional","affiliation":[{"name":"British Telecom"}]}],"member":"320","published-online":{"date-parts":[[2020,10,26]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP.2019.00042"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098021"},{"key":"e_1_3_2_1_3_1","volume-title":"Conference on Systems and Machine Learning (SysML). https:\/\/www.sysml.cc\/doc\/2019\/167","author":"Breck Eric","year":"2019","unstructured":"Eric Breck , Neoklis Polyzotis , Sudip Roy , Steven Euijong Whang , and Martin Zinkevich . 2019 . Data validation for machine learning . In Conference on Systems and Machine Learning (SysML). https:\/\/www.sysml.cc\/doc\/2019\/167 .pdf. Eric Breck, Neoklis Polyzotis, Sudip Roy, Steven Euijong Whang, and Martin Zinkevich. 2019. Data validation for machine learning. In Conference on Systems and Machine Learning (SysML). https:\/\/www.sysml.cc\/doc\/2019\/167.pdf."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2011.2160459"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA.2018.00059"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-75488-6_27"},{"key":"e_1_3_2_1_7_1","volume-title":"High-Performance ML Serving. CoRR abs\/1712.06139","author":"Olston Christopher","year":"2017","unstructured":"Christopher Olston , Noah Fiedel , Kiril Gorovoy , Jeremiah Harmsen , Li Lao , Fangwei Li , Vinu Rajashekhar , Sukriti Ramesh , and Jordan Soyke . 2017. TensorFlow-Serving : Flexible , High-Performance ML Serving. CoRR abs\/1712.06139 ( 2017 ). arXiv:1712.06139 http:\/\/arxiv.org\/abs\/1712.06139 Christopher Olston, Noah Fiedel, Kiril Gorovoy, Jeremiah Harmsen, Li Lao, Fangwei Li, Vinu Rajashekhar, Sukriti Ramesh, and Jordan Soyke. 2017. TensorFlow-Serving: Flexible, High-Performance ML Serving. CoRR abs\/1712.06139 (2017). arXiv:1712.06139 http:\/\/arxiv.org\/abs\/1712.06139"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299887.3299891"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2015.7280527"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1006515405170"},{"key":"e_1_3_2_1_11_1","volume-title":"Machine Learning Systems Workshop at NIPS. 27--29","author":"Schelter Sebastian","year":"2017","unstructured":"Sebastian Schelter , Joos-Hendrik Boese , Johannes Kirschnick , Thoralf Klein , and Stephan Seufert . 2017 . Automatically tracking metadata and provenance of machine learning experiments . In Machine Learning Systems Workshop at NIPS. 27--29 . Sebastian Schelter, Joos-Hendrik Boese, Johannes Kirschnick, Thoralf Klein, and Stephan Seufert. 2017. Automatically tracking metadata and provenance of machine learning experiments. In Machine Learning Systems Workshop at NIPS. 27--29."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.14778\/3229863.3229867"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022810614389"},{"key":"e_1_3_2_1_14_1","volume-title":"Hidden Technical Debt in Machine Learning Systems. In Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015","author":"Sculley D.","year":"2015","unstructured":"D. Sculley , Gary Holt , Daniel Golovin , Eugene Davydov , Todd Phillips , Dietmar Ebner , Vinay Chaudhary , Michael Young , Jean-Fran\u00e7ois Crespo , and Dan Dennison . 2015 . Hidden Technical Debt in Machine Learning Systems. In Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015 , December 7-12, 2015, Montreal, Quebec, Canada, Corinna Cortes, Neil D. Lawrence, Daniel D. Lee, Masashi Sugiyama, and Roman Garnett (Eds.). 2503--2511. http:\/\/papers.nips.cc\/paper\/5656-hidden-technical-debt-in-machine-learning-systems D. Sculley, Gary Holt, Daniel Golovin, Eugene Davydov, Todd Phillips, Dietmar Ebner, Vinay Chaudhary, Michael Young, Jean-Fran\u00e7ois Crespo, and Dan Dennison. 2015. Hidden Technical Debt in Machine Learning Systems. In Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, December 7-12, 2015, Montreal, Quebec, Canada, Corinna Cortes, Neil D. Lawrence, Daniel D. Lee, Masashi Sugiyama, and Roman Garnett (Eds.). 2503--2511. http:\/\/papers.nips.cc\/paper\/5656-hidden-technical-debt-in-machine-learning-systems"},{"key":"e_1_3_2_1_15_1","unstructured":"Arnaud Van Looveren Giovanni Vacanti Janis Klaise and Alexandru Coca. [n.d.]. Alibi-Detect: Algorithms for outlier and adversarial instance detection concept drift and metrics. https:\/\/github.com\/SeldonIO\/alibi-detect  Arnaud Van Looveren Giovanni Vacanti Janis Klaise and Alexandru Coca. [n.d.]. Alibi-Detect: Algorithms for outlier and adversarial instance detection concept drift and metrics. https:\/\/github.com\/SeldonIO\/alibi-detect"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2641190.2641198"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939502.2939516"},{"key":"e_1_3_2_1_18_1","unstructured":"P Vincent K Lijima Mark Driver Jason Wong and Yefim Natis. 2019. Magic Quadrant for Enterprise Low-Code Application Platforms.  P Vincent K Lijima Mark Driver Jason Wong and Yefim Natis. 2019. Magic Quadrant for Enterprise Low-Code Application Platforms."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-56602-3_139"},{"key":"e_1_3_2_1_20_1","first-page":"39","article-title":"Accelerating the Machine Learning Lifecycle with MLflow","volume":"41","author":"Zaharia Matei","year":"2018","unstructured":"Matei Zaharia , Andrew Chen , Aaron Davidson , Ali Ghodsi , Sue Ann Hong , Andy Konwinski , Siddharth Murching , Tomas Nykodym , Paul Ogilvie , Mani Parkhe , Fen Xie , and Corey Zumar . 2018 . Accelerating the Machine Learning Lifecycle with MLflow . IEEE Data Eng. Bull. 41 , 4 (2018), 39 -- 45 . http:\/\/sites.computer.org\/debull\/A18dec\/p39.pdf Matei Zaharia, Andrew Chen, Aaron Davidson, Ali Ghodsi, Sue Ann Hong, Andy Konwinski, Siddharth Murching, Tomas Nykodym, Paul Ogilvie, Mani Parkhe, Fen Xie, and Corey Zumar. 2018. Accelerating the Machine Learning Lifecycle with MLflow. IEEE Data Eng. Bull. 41, 4 (2018), 39--45. http:\/\/sites.computer.org\/debull\/A18dec\/p39.pdf","journal-title":"IEEE Data Eng. Bull."}],"event":{"name":"MODELS '20: ACM\/IEEE 23rd International Conference on Model Driven Engineering Languages and Systems","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE CS"],"location":"Virtual Event Canada","acronym":"MODELS '20"},"container-title":["Proceedings of the 23rd ACM\/IEEE International Conference on Model Driven Engineering Languages and Systems: Companion Proceedings"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3417990.3420196","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3417990.3420196","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:35Z","timestamp":1750195895000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3417990.3420196"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,16]]},"references-count":20,"alternative-id":["10.1145\/3417990.3420196","10.1145\/3417990"],"URL":"https:\/\/doi.org\/10.1145\/3417990.3420196","relation":{},"subject":[],"published":{"date-parts":[[2020,10,16]]},"assertion":[{"value":"2020-10-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}