{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,7]],"date-time":"2025-08-07T09:17:24Z","timestamp":1754558244289,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":30,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,5,19]],"date-time":"2022-05-19T00:00:00Z","timestamp":1652918400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Mitacs Canada, SAP Canada","award":["IT09795"],"award-info":[{"award-number":["IT09795"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,5,19]]},"DOI":"10.1145\/3526073.3527593","type":"proceedings-article","created":{"date-parts":[[2023,2,3]],"date-time":"2023-02-03T23:06:43Z","timestamp":1675465603000},"page":"21-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Challenges in machine learning application development"],"prefix":"10.1145","author":[{"given":"Md Saidur","family":"Rahman","sequence":"first","affiliation":[{"name":"Polytechnique Montreal, Canada"}]},{"given":"Foutse","family":"Khomh","sequence":"additional","affiliation":[{"name":"Polytechnique Montreal, Canada"}]},{"given":"Emilio","family":"Rivera","sequence":"additional","affiliation":[{"name":"Polytechnique Montreal, Canada"}]},{"given":"Yann-Ga\u00ebl","family":"Gu\u00e9h\u00e9neuc","sequence":"additional","affiliation":[{"name":"Concordia University, Canada"}]},{"given":"Bernd","family":"Lehnert","sequence":"additional","affiliation":[{"name":"SAP Montreal, Canada"}]}],"member":"320","published-online":{"date-parts":[[2023,2,3]]},"reference":[{"volume-title":"Proc. ICSE-SEIP. 291--300","author":"Amershi S.","key":"e_1_3_2_1_1_1","unstructured":"S. Amershi , A. Begel , C. Bird , R. DeLine , H. Gall , E. Kamar , N. Nagappan , B. Nushi , and T. Zimmermann . 2019. Software Engineering for Machine Learning: A Case Study . In Proc. ICSE-SEIP. 291--300 . S. Amershi, A. Begel, C. Bird, R. DeLine, H. Gall, E. Kamar, N. Nagappan, B. Nushi, and T. Zimmermann. 2019. Software Engineering for Machine Learning: A Case Study. In Proc. ICSE-SEIP. 291--300."},{"volume-title":"Proc. ICIS. 181--184","author":"Attarha M.","key":"e_1_3_2_1_2_1","unstructured":"M. Attarha and N. Modiri . 2011. Focusing on the importance and the role of requirement engineering . In Proc. ICIS. 181--184 . M. Attarha and N. Modiri. 2011. Focusing on the importance and the role of requirement engineering. In Proc. ICIS. 181--184."},{"key":"e_1_3_2_1_3_1","unstructured":"J. Attenberg P. Melville F. Provost and M. Saar-Tsechansky. 2011. Selective data acquisition for machine learning. 101--155.  J. Attenberg P. Melville F. Provost and M. Saar-Tsechansky. 2011. Selective data acquisition for machine learning. 101--155."},{"key":"e_1_3_2_1_4_1","unstructured":"A. Bibal and B.\u00eet Fr\u00e9nay. 2016. Interpretability of machine learning models and representations: an introduction.. In ESANN.  A. Bibal and B.\u00eet Fr\u00e9nay. 2016. Interpretability of machine learning models and representations: an introduction.. In ESANN."},{"key":"e_1_3_2_1_5_1","unstructured":"F. Doshi-Velez and B. Kim. 2017. Towards A Rigorous Science of Interpretable Machine Learning. arXiv:1702.08608  F. Doshi-Velez and B. Kim. 2017. Towards A Rigorous Science of Interpretable Machine Learning. arXiv:1702.08608"},{"key":"e_1_3_2_1_6_1","unstructured":"F. Khomh and G. Antoniol. 2018. Bringing AI and machine learning data science into operation. https:\/\/www.redhat.com\/en\/blog\/bringing-ai-and-machine-learning-data-science-operation\/.  F. Khomh and G. Antoniol. 2018. Bringing AI and machine learning data science into operation. https:\/\/www.redhat.com\/en\/blog\/bringing-ai-and-machine-learning-data-science-operation\/."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5381\/jot.2007.6.1.c2"},{"key":"e_1_3_2_1_8_1","volume-title":"Testing mcmc code. arXiv preprint arXiv:1412.5218","author":"Grosse R B","year":"2014","unstructured":"R B Grosse and D K Duvenaud . 2014. Testing mcmc code. arXiv preprint arXiv:1412.5218 ( 2014 ). R B Grosse and D K Duvenaud. 2014. Testing mcmc code. arXiv preprint arXiv:1412.5218 (2014)."},{"key":"e_1_3_2_1_9_1","unstructured":"I. Guyon S. Gunn M. Nikravesh and L. A. Zadeh. 2008. Feature extraction: foundations and applications. Vol. 207. Springer.  I. Guyon S. Gunn M. Nikravesh and L. A. Zadeh. 2008. Feature extraction: foundations and applications. Vol. 207. Springer."},{"volume-title":"Machine Learning for Designers","author":"Hebron P.","key":"e_1_3_2_1_10_1","unstructured":"P. Hebron . 2016. Machine Learning for Designers . O'Reilly Inc . P. Hebron. 2016. Machine Learning for Designers. O'Reilly Inc."},{"volume-title":"Proc. WAIN. 1--4.","author":"Heck P.","key":"e_1_3_2_1_11_1","unstructured":"P. Heck and G. Schouten . 2021. Lessons Learned from Educating AI Engineers . In Proc. WAIN. 1--4. P. Heck and G. Schouten. 2021. Lessons Learned from Educating AI Engineers. In Proc. WAIN. 1--4."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","unstructured":"F. Herrera S. Ventura R. Bello C. Cornelis A. Zafra D. S\u00e1nchez-Tarrag\u00f3 and S. Vluymans. 2016. Multiple Instance Learning. Springer.  F. Herrera S. Ventura R. Bello C. Cornelis A. Zafra D. S\u00e1nchez-Tarrag\u00f3 and S. Vluymans. 2016. Multiple Instance Learning. Springer.","DOI":"10.1007\/978-3-319-47759-6"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"crossref","unstructured":"G. E. Hinton and R. R. Salakhutdinov. 2006. Reducing the Dimensionality of Data with Neural Networks. Science 313 5786 (2006) 504--507.  G. E. Hinton and R. R. Salakhutdinov. 2006. Reducing the Dimensionality of Data with Neural Networks. Science 313 5786 (2006) 504--507.","DOI":"10.1126\/science.1127647"},{"volume-title":"Proc. WAIN. 129--132","author":"Lanubile F.","key":"e_1_3_2_1_14_1","unstructured":"F. Lanubile , F. Calefato , L. Quaranta , M. Amoruso , F. Fumarola , and M. Filannino . 2021. Towards Productizing AI\/ML Models: An Industry Perspective from Data Scientists . In Proc. WAIN. 129--132 . F. Lanubile, F. Calefato, L. Quaranta, M. Amoruso, F. Fumarola, and M. Filannino. 2021. Towards Productizing AI\/ML Models: An Industry Perspective from Data Scientists. In Proc. WAIN. 129--132."},{"key":"e_1_3_2_1_15_1","unstructured":"C. Murphy G. E. Kaiser and M. Arias. 2007. An approach to software testing of machine learning applications. (2007).  C. Murphy G. E. Kaiser and M. Arias. 2007. An approach to software testing of machine learning applications. (2007)."},{"key":"e_1_3_2_1_16_1","unstructured":"A. Paleyes R. Urma and N. D. Lawrence. 2020. Challenges in Deploying Machine Learning: a Survey of Case Studies. CoRR (2020). https:\/\/arxiv.org\/abs\/2011.09926  A. Paleyes R. Urma and N. D. Lawrence. 2020. Challenges in Deploying Machine Learning: a Survey of Case Studies. CoRR (2020). https:\/\/arxiv.org\/abs\/2011.09926"},{"volume-title":"Proc. SOSP. 1--18","author":"Pei K.","key":"e_1_3_2_1_17_1","unstructured":"K. Pei , Y. Cao , J. Yang , and S. Jana . 2017. Deepxplore: Automated whitebox testing of deep learning systems . In Proc. SOSP. 1--18 . K. Pei, Y. Cao, J. Yang, and S. Jana. 2017. Deepxplore: Automated whitebox testing of deep learning systems. In Proc. SOSP. 1--18."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2017.01.078"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2019.2946162"},{"volume-title":"Proc. ICSE-SEIP. 73--82","author":"Sandberg A. B.","key":"e_1_3_2_1_20_1","unstructured":"A. B. Sandberg and I. Crnkovic . 2017. Meeting Industry-Academia Research Collaboration Challenges with Agile Methodologies . In Proc. ICSE-SEIP. 73--82 . A. B. Sandberg and I. Crnkovic. 2017. Meeting Industry-Academia Research Collaboration Challenges with Agile Methodologies. In Proc. ICSE-SEIP. 73--82."},{"key":"e_1_3_2_1_21_1","first-page":"5","article-title":"On Challenges in Machine Learning Model Management","volume":"41","author":"Schelter S.","year":"2018","unstructured":"S. Schelter , F. Bie\u00dfmann , T. Januschowski , D. Salinas , S. Seufert , and G. Szarvas . 2018 . On Challenges in Machine Learning Model Management . IEEE Data Eng. Bull. 41 (2018), 5 -- 15 . S. Schelter, F. Bie\u00dfmann, T. Januschowski, D. Salinas, S. Seufert, and G. Szarvas. 2018. On Challenges in Machine Learning Model Management. IEEE Data Eng. Bull. 41 (2018), 5--15.","journal-title":"IEEE Data Eng. Bull."},{"key":"e_1_3_2_1_22_1","unstructured":"K. Schwaber and M. Beedle. 2002. Agile software development with Scrum. Vol. 1. Prentice Hall Upper Saddle River.  K. Schwaber and M. Beedle. 2002. Agile software development with Scrum. Vol. 1. Prentice Hall Upper Saddle River."},{"key":"e_1_3_2_1_23_1","volume-title":"Machine Learning: The High Interest Credit Card of Technical Debt. In SE4ML (NIPS 2014 Workshop).","author":"Sculley D.","year":"2014","unstructured":"D. Sculley , G. Holt , D. Golovin , E. Davydov , T. Phillips , D. Ebner , V. Chaudhary , and M. Young . 2014 . Machine Learning: The High Interest Credit Card of Technical Debt. In SE4ML (NIPS 2014 Workshop). D. Sculley, G. Holt, D. Golovin, E. Davydov, T. Phillips, D. Ebner, V. Chaudhary, and M. Young. 2014. Machine Learning: The High Interest Credit Card of Technical Debt. In SE4ML (NIPS 2014 Workshop)."},{"volume-title":"Proc. WAIN. 97--100","author":"Serban A.","key":"e_1_3_2_1_24_1","unstructured":"A. Serban , K. van der Blom, H. Hoos, and J. Visser. 2021. Practices for Engineering Trustworthy Machine Learning Applications . In Proc. WAIN. 97--100 . A. Serban, K. van der Blom, H. Hoos, and J. Visser. 2021. Practices for Engineering Trustworthy Machine Learning Applications. In Proc. WAIN. 97--100."},{"key":"e_1_3_2_1_25_1","unstructured":"D. Storcheus A. Rostamizadeh and S. Kumar. 2015. A survey of modern questions and challenges in feature extraction. In Feature Extraction: Modern Questions and Challenges. 1--18.  D. Storcheus A. Rostamizadeh and S. Kumar. 2015. A survey of modern questions and challenges in feature extraction. In Feature Extraction: Modern Questions and Challenges. 1--18."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"crossref","unstructured":"C. Wohlin P. Runeson M. H\u00f6st M. C. Ohlsson B. Regnell and A. Wessl\u00e9n. 2012. Experimentation in software engineering. Springer.  C. Wohlin P. Runeson M. H\u00f6st M. C. Ohlsson B. Regnell and A. Wessl\u00e9n. 2012. Experimentation in software engineering. Springer.","DOI":"10.1007\/978-3-642-29044-2"},{"volume-title":"Proc. WAIN. 70--73","author":"Xie Yuanhao","key":"e_1_3_2_1_27_1","unstructured":"Yuanhao Xie , Lu\u00eds Cruz , Petra Heck , and Jan S. Rellermeyer . 2021. Systematic Mapping Study on the Machine Learning Lifecycle . In Proc. WAIN. 70--73 . Yuanhao Xie, Lu\u00eds Cruz, Petra Heck, and Jan S. Rellermeyer. 2021. Systematic Mapping Study on the Machine Learning Lifecycle. In Proc. WAIN. 70--73."},{"volume-title":"Case study research and applications: Design and methods","author":"Yin R. K.","key":"e_1_3_2_1_28_1","unstructured":"R. K. Yin . 2017. Case study research and applications: Design and methods . Sage publications. R. K. Yin. 2017. Case study research and applications: Design and methods. Sage publications."},{"key":"e_1_3_2_1_29_1","unstructured":"M. Zaharia. 2018. MLflow: A platform for managing the machine learning lifecycle. https:\/\/www.oreilly.com\/content\/mlflow-a-platform-for-managing-the-machine-learning-lifecycle\/.  M. Zaharia. 2018. MLflow: A platform for managing the machine learning lifecycle. https:\/\/www.oreilly.com\/content\/mlflow-a-platform-for-managing-the-machine-learning-lifecycle\/."},{"key":"e_1_3_2_1_30_1","unstructured":"M. Zinkevich. 2017. Rules of machine learning: Best practices for ML engineering. https:\/\/developers.google.com\/machine-learning\/guides\/rules-of-ml.  M. Zinkevich. 2017. Rules of machine learning: Best practices for ML engineering. https:\/\/developers.google.com\/machine-learning\/guides\/rules-of-ml."}],"event":{"name":"ICSE '22: 44th International Conference on Software Engineering","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE CS"],"location":"Pittsburgh Pennsylvania","acronym":"ICSE '22"},"container-title":["Proceedings of the 1st Workshop on Software Engineering for Responsible AI"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3526073.3527593","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3526073.3527593","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T18:43:46Z","timestamp":1750272226000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3526073.3527593"}},"subtitle":["an industrial experience report"],"short-title":[],"issued":{"date-parts":[[2022,5,19]]},"references-count":30,"alternative-id":["10.1145\/3526073.3527593","10.1145\/3526073"],"URL":"https:\/\/doi.org\/10.1145\/3526073.3527593","relation":{},"subject":[],"published":{"date-parts":[[2022,5,19]]},"assertion":[{"value":"2023-02-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}