{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,28]],"date-time":"2025-09-28T04:14:09Z","timestamp":1759032849197,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":21,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,6,26]],"date-time":"2020-06-26T00:00:00Z","timestamp":1593129600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,6,26]]},"DOI":"10.1145\/3379177.3388905","type":"proceedings-article","created":{"date-parts":[[2020,9,16]],"date-time":"2020-09-16T10:13:30Z","timestamp":1600251210000},"page":"125-134","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["Emerging and Changing Tasks in the Development Process for Machine Learning Systems"],"prefix":"10.1145","author":[{"given":"Hanyan","family":"Liu","sequence":"first","affiliation":[{"name":"Chalmers | University of Gothenburg, Gothenburg, Sweden"}]},{"given":"Samuel","family":"Eksmo","sequence":"additional","affiliation":[{"name":"Chalmers | University of Gothenburg, Gothenburg, Sweden"}]},{"given":"Johan","family":"Risberg","sequence":"additional","affiliation":[{"name":"IBM Sweden, Gothenburg, Sweden"}]},{"given":"Regina","family":"Hebig","sequence":"additional","affiliation":[{"name":"Chalmers | University of Gothenburg, Gothenburg, Sweden"}]}],"member":"320","published-online":{"date-parts":[[2020,9,16]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Software Engineering for Machine Learning: A Case Study. XP 2019 (forthcoming)","author":"Amershi Saleema","year":"2019","unstructured":"Saleema Amershi , Andrew Begel , Christian Bird , Rob DeLine , Harald Gall , Ece Kamar , Nachiappan Nagappan , Besmira Nushi , and Thomas Zimmermann . 2019 . Software Engineering for Machine Learning: A Case Study. XP 2019 (forthcoming) (2019). Saleema Amershi, Andrew Begel, Christian Bird, Rob DeLine, Harald Gall, Ece Kamar, Nachiappan Nagappan, Besmira Nushi, and Thomas Zimmermann. 2019. Software Engineering for Machine Learning: A Case Study. XP 2019 (forthcoming) (2019)."},{"key":"e_1_3_2_1_2_1","volume-title":"Software Engineering Challenges of Deep Learning. CoRR abs\/1810.12034","author":"Arpteg Anders","year":"2018","unstructured":"Anders Arpteg , Bj\u00f6rn Brinne , Luka Crnkovic-Friis , and Jan Bosch . 2018. Software Engineering Challenges of Deep Learning. CoRR abs\/1810.12034 ( 2018 ). arXiv:1810.12034 http:\/\/arxiv.org\/abs\/1810.12034 Anders Arpteg, Bj\u00f6rn Brinne, Luka Crnkovic-Friis, and Jan Bosch. 2018. Software Engineering Challenges of Deep Learning. CoRR abs\/1810.12034 (2018). arXiv:1810.12034 http:\/\/arxiv.org\/abs\/1810.12034"},{"key":"e_1_3_2_1_3_1","volume-title":"Assuring the machine learning lifecycle: Desiderata, methods, and challenges. arXiv preprint arXiv:1905.04223","author":"Ashmore Rob","year":"2019","unstructured":"Rob Ashmore , Radu Calinescu , and Colin Paterson . 2019. Assuring the machine learning lifecycle: Desiderata, methods, and challenges. arXiv preprint arXiv:1905.04223 ( 2019 ). Rob Ashmore, Radu Calinescu, and Colin Paterson. 2019. Assuring the machine learning lifecycle: Desiderata, methods, and challenges. arXiv preprint arXiv:1905.04223 (2019)."},{"key":"e_1_3_2_1_4_1","volume-title":"First steps in qualitative data analysis: transcribing. Family Practice 25, 2 (02","author":"Bailey Julia","year":"2008","unstructured":"Julia Bailey . 2008. First steps in qualitative data analysis: transcribing. Family Practice 25, 2 (02 2008 ), 127--131. https:\/\/doi.org\/10.1093\/fampra\/cmn003arXiv:http:\/\/oup.prod.sis.lan\/fampra\/article-pdf\/25\/2\/127\/1341812\/cmn003.pdf 10.1093\/fampra Julia Bailey. 2008. First steps in qualitative data analysis: transcribing. Family Practice 25, 2 (02 2008), 127--131. https:\/\/doi.org\/10.1093\/fampra\/cmn003arXiv:http:\/\/oup.prod.sis.lan\/fampra\/article-pdf\/25\/2\/127\/1341812\/cmn003.pdf"},{"key":"e_1_3_2_1_5_1","volume-title":"Understanding Development Process of Machine Learning Systems: Challenges and Solutions. In 2019 ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). IEEE, 1--6.","author":"de Souza Nascimento Elizamary","year":"2019","unstructured":"Elizamary de Souza Nascimento , Iftekhar Ahmed , Edson Oliveira , M\u00e1rcio Piedade Palheta , Igor Steinmacher , and Tayana Conte . 2019 . Understanding Development Process of Machine Learning Systems: Challenges and Solutions. In 2019 ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). IEEE, 1--6. Elizamary de Souza Nascimento, Iftekhar Ahmed, Edson Oliveira, M\u00e1rcio Piedade Palheta, Igor Steinmacher, and Tayana Conte. 2019. Understanding Development Process of Machine Learning Systems: Challenges and Solutions. In 2019 ACM\/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). IEEE, 1--6."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_6_1","DOI":"10.1145\/2884781.2884783"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_7_1","DOI":"10.1145\/3279996.3280041"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_8_1","DOI":"10.1007\/978-3-030-19034-7_14"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_9_1","DOI":"10.5555\/2930830"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_10_1","DOI":"10.1145\/3035918.3054782"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_11_1","DOI":"10.1007\/s10664-008-9102-8"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_12_1","DOI":"10.5555\/2361717"},{"key":"e_1_3_2_1_13_1","volume-title":"Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. arXiv preprint arXiv:1708.08296","author":"Samek Wojciech","year":"2017","unstructured":"Wojciech Samek , Thomas Wiegand , and Klaus-Robert M\u00fcller . 2017. Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. arXiv preprint arXiv:1708.08296 ( 2017 ). Wojciech Samek, Thomas Wiegand, and Klaus-Robert M\u00fcller. 2017. Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. arXiv preprint arXiv:1708.08296 (2017)."},{"key":"e_1_3_2_1_14_1","volume-title":"Preparing and architecting for machine learning. Gartner Technical Professional Advice","author":"Sapp Carlton E","year":"2017","unstructured":"Carlton E Sapp . 2017. Preparing and architecting for machine learning. Gartner Technical Professional Advice ( 2017 ), 1--37. Carlton E Sapp. 2017. Preparing and architecting for machine learning. Gartner Technical Professional Advice (2017), 1--37."},{"unstructured":"David Sculley Gary Holt Daniel Golovin Eugene Davydov Todd Phillips Dietmar Ebner Vinay Chaudhary Michael Young Jean-Francois Crespo and Dan Dennison. 2015. Hidden technical debt in machine learning systems. In Advances in neural information processing systems. 2503--2511. 10.5555\/2969442.2969519  David Sculley Gary Holt Daniel Golovin Eugene Davydov Todd Phillips Dietmar Ebner Vinay Chaudhary Michael Young Jean-Francois Crespo and Dan Dennison. 2015. Hidden technical debt in machine learning systems. In Advances in neural information processing systems. 2503--2511. 10.5555\/2969442.2969519","key":"e_1_3_2_1_15_1"},{"key":"e_1_3_2_1_16_1","volume-title":"Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nursing & health sciences 15, 3","author":"Vaismoradi Mojtaba","year":"2013","unstructured":"Mojtaba Vaismoradi , Hannele Turunen , and Terese Bondas . 2013. Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nursing & health sciences 15, 3 ( 2013 ), 398--405. Mojtaba Vaismoradi, Hannele Turunen, and Terese Bondas. 2013. Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nursing & health sciences 15, 3 (2013), 398--405."},{"key":"e_1_3_2_1_17_1","volume-title":"How does Machine Learning Change Software Development Practices? IEEE Transactions on Software Engineering","author":"Wan Zhiyuan","year":"2019","unstructured":"Zhiyuan Wan , Xin Xia , David Lo , and Gail C Murphy . 2019. How does Machine Learning Change Software Development Practices? IEEE Transactions on Software Engineering ( 2019 ). Zhiyuan Wan, Xin Xia, David Lo, and Gail C Murphy. 2019. How does Machine Learning Change Software Development Practices? IEEE Transactions on Software Engineering (2019)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_18_1","DOI":"10.1109\/IWESEP49350.2019.00017"},{"key":"e_1_3_2_1_19_1","volume-title":"Preliminary Systematic Literature Review of Machine Learning System Development Process. arXiv preprint arXiv:1910.05528","author":"Watanabe Yasuhiro","year":"2019","unstructured":"Yasuhiro Watanabe , Hironori Washizaki , Kazunori Sakamoto , Daisuke Saito , Kiyoshi Honda , Naohiko Tsuda , Yoshiaki Fukazawa , and Nobukazu Yoshioka . 2019. Preliminary Systematic Literature Review of Machine Learning System Development Process. arXiv preprint arXiv:1910.05528 ( 2019 ). Yasuhiro Watanabe, Hironori Washizaki, Kazunori Sakamoto, Daisuke Saito, Kiyoshi Honda, Naohiko Tsuda, Yoshiaki Fukazawa, and Nobukazu Yoshioka. 2019. Preliminary Systematic Literature Review of Machine Learning System Development Process. arXiv preprint arXiv:1910.05528 (2019)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_20_1","DOI":"10.1109\/ISSRE.2019.00020"},{"key":"e_1_3_2_1_21_1","volume-title":"Visualizing deep neural network decisions: Prediction difference analysis. arXiv preprint arXiv:1702.04595","author":"Zintgraf Luisa M","year":"2017","unstructured":"Luisa M Zintgraf , Taco S Cohen , Tameem Adel , and Max Welling . 2017. Visualizing deep neural network decisions: Prediction difference analysis. arXiv preprint arXiv:1702.04595 ( 2017 ). Luisa M Zintgraf, Taco S Cohen, Tameem Adel, and Max Welling. 2017. Visualizing deep neural network decisions: Prediction difference analysis. arXiv preprint arXiv:1702.04595 (2017)."}],"event":{"sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE CS"],"acronym":"ICSSP '20","name":"ICSSP '20: International Conference on Software and System Processes","location":"Seoul Republic of Korea"},"container-title":["Proceedings of the International Conference on Software and System Processes"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3379177.3388905","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3379177.3388905","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:41:02Z","timestamp":1750200062000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3379177.3388905"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,26]]},"references-count":21,"alternative-id":["10.1145\/3379177.3388905","10.1145\/3379177"],"URL":"https:\/\/doi.org\/10.1145\/3379177.3388905","relation":{},"subject":[],"published":{"date-parts":[[2020,6,26]]},"assertion":[{"value":"2020-09-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}