{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T22:58:19Z","timestamp":1778885899052,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":35,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,5,16]],"date-time":"2022-05-16T00:00:00Z","timestamp":1652659200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,5,16]]},"DOI":"10.1145\/3522664.3528595","type":"proceedings-article","created":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T16:30:14Z","timestamp":1666024214000},"page":"124-135","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["The goldilocks framework"],"prefix":"10.1145","author":[{"given":"Rimma","family":"Dzhusupova","sequence":"first","affiliation":[{"name":"McDermott, The Hague, The Netherlands"}]},{"given":"Jan","family":"Bosch","sequence":"additional","affiliation":[{"name":"Chalmers University of Technology, Gothenburg, Sweden"}]},{"given":"Helena Holmstr\u00f6m","family":"Olsson","sequence":"additional","affiliation":[{"name":"Malm\u00f6 University, Malm\u00f6, Sweden"}]}],"member":"320","published-online":{"date-parts":[[2022,10,17]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Rohit Panikkar Tamim Saleh Maxime Szybowski and Rob Whiteman September 2021. Operationalizing machine learning in processes McKinsey&Company."},{"key":"e_1_3_2_1_2_1","unstructured":"L. Karen Soiferman 2010. Compare and Contrast Inductive and Deductive Research Approaches."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP.2019.00042"},{"key":"e_1_3_2_1_4_1","unstructured":"Mark Tab Alex Buck Kent Sharkey December 2021. What is the Team Data Science Process? https:\/\/docs.microsoft.com\/en-us\/azure\/architecture\/data-science-process\/overview."},{"key":"e_1_3_2_1_5_1","volume-title":"Gregory Piatetsky - Shapiro, and Padhraic Smyth","author":"Usama Fayyad","year":"1996","unstructured":"Usama Fayyad, Gregory Piatetsky - Shapiro, and Padhraic Smyth, 1996. The KDD Process for Extracting Useful Knowledge from Volumes of Data; COMMUNICATIONS OF THE ACM November 1996\/Vol. 39, No. 11."},{"key":"e_1_3_2_1_6_1","volume-title":"Proceedings of the 4th International Conference on the Practical Applications of Knowledge Discovery and Data Mining.","author":"Wirth R.","year":"2000","unstructured":"Wirth, R. & Hipp, Jochen, 2000. CRISP-DM: Towards a standard process model for data mining. Proceedings of the 4th International Conference on the Practical Applications of Knowledge Discovery and Data Mining."},{"key":"e_1_3_2_1_7_1","article-title":". The Machine Learning Audit-CRISP-DM Framework","volume":"1","author":"Clark","year":"2018","unstructured":"A. Clark, 2018. The Machine Learning Audit-CRISP-DM Framework. Isaca Journal, vol. 1, https:\/\/www.isaca.org\/resources\/isaca-journal\/issues\/2018\/volume-l\/the-machine-learning-auditcrisp-dm-framework.","journal-title":"Isaca Journal"},{"key":"e_1_3_2_1_8_1","volume-title":"November","author":"Finland Germany","year":"2020","unstructured":"Supreme Audit Institutions of Finland, Germany, the Netherlands, Norway and the UK, November 2020. Auditing machine learning algorithms. A white paper for public auditors."},{"key":"e_1_3_2_1_9_1","unstructured":"IEC 61508-1:2010. Functional safety of electrical\/electronic\/programmable electronic safety-related systems - Part 1: General requirements."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.114820"},{"key":"e_1_3_2_1_11_1","volume-title":"Surveys & Meta-Analyses Workshop, NeurIPS 2020; v2","author":"Andrei Paleyes Raoul-Gabriel","year":"2021","unstructured":"Andrei Paleyes, Raoul-Gabriel Urma, Neil D. Lawrence Challenges in Deploying Machine Learning: a Survey of Case Studies, Cornell University, The ML-Retrospectives, Surveys & Meta-Analyses Workshop, NeurIPS 2020; v2, January 18, 2021, https:\/\/arxiv.org\/abs\/2011.09926v2."},{"key":"e_1_3_2_1_12_1","unstructured":"Tara Balakrishnan Michael Chui Bryce Hall Nicolaus Henke November 2020. McKinsey Digital McKinsey Analystics Global survey: The state of AI in 2020 https:\/\/www.mckinsey.com\/business-functions\/mckinsey-analytics\/our-insights\/global-survey-the-state-of-ai-in-2020."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1080\/21693277.2016.1192517"},{"key":"e_1_3_2_1_14_1","unstructured":"Gartner Stamford Conn. January 21 2019. Press Release STAMFORD Conn. Gartner Survey Shows 37 Percent of Organizations Have Implemented AI in Some Form https:\/\/www.gartner.com\/en\/newsroom\/press-releases\/2019-01-21-gartner-survey-shows-37-percent-of-organizations-have."},{"key":"e_1_3_2_1_15_1","unstructured":"VentureBeat July 8 2019. IDC: For 1 in 4 companies half of all AI projects fail https:\/\/venturebeat.com\/2019\/07\/08\/idc-for-l-in-4-companies-half-of-all-ai-projects-fail\/ based on IDC's Artificial Intelligence Global Adoption Trends & Strategies report."},{"key":"e_1_3_2_1_16_1","volume-title":"The State of Development and Operations of AI Applications","author":"Dotscience","year":"2019","unstructured":"Dotscience, The State of Development and Operations of AI Applications 2019, https:\/\/dotscience.com\/assets\/downloads\/Dotscience_Survey-Report-2019.pdf."},{"key":"e_1_3_2_1_17_1","unstructured":"Dimensional research (supported by ALEGION) May 2019. Artificial Intelligence and Machine Learning Projects Are Obstructed by Data Issues Global Survey of Data Scientists AI Experts and Stakeholders https:\/\/telecomreseller.com\/wp-content\/uploads\/2019\/05\/EMBARGOED-UNTIL-800-AM-ET-0523-Dimensional-Research-Machine-Leaming-PPT-Report-FrNAL.pdf?_cf_chl_captchaJk_=pmd_AwcVShnc7Fkq4MiTuEeql01jYQZkMULLHaNC0H4mIc0-1633021250-0-gqNtZGzNA5CjcnBszQdl."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/9781119176350.ch12"},{"key":"e_1_3_2_1_19_1","first-page":"285","volume-title":"Selecting Empirical Methods for Software Engineering Research. Guide to Advanced Empirical Software Engineering","author":"Steve Easterbrook Janice Singer","year":"2007","unstructured":"Steve Easterbrook, Janice Singer, Margaret-Anne Storey, and Daniela Damian (2007). Selecting Empirical Methods for Software Engineering Research. Guide to Advanced Empirical Software Engineering, pp. 285--311."},{"key":"e_1_3_2_1_20_1","unstructured":"Machine Learning Engineering for Production (MLOps) Specialization Coursera (lecture notes) Machine Learning Engineering for Production (MLOps) | Coursera."},{"key":"e_1_3_2_1_21_1","first-page":"2494","author":"Sculley D","year":"2015","unstructured":"Sculley, D & Holt, Gary & Golovin, Daniel & Davydov, Eugene & Phillips, Todd & Ebner, Dietmar & Chaudhary, Vinay & Young, Michael & Dennison, Dan., 2015. Hidden Technical Debt in Machine Learning Systems. NIPS. 2494-2502.","journal-title":"Hidden Technical Debt in Machine Learning Systems. NIPS."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372873"},{"key":"e_1_3_2_1_23_1","unstructured":"Ashmore R. Calinescu R. & Paterson C 2019. Assuring the Machine Learning Lifecycle: Desiderata Methods and Challenges. ArXiv abs\/1905.04223."},{"key":"e_1_3_2_1_24_1","first-page":"162","volume-title":"2016 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC)","author":"Hill R. Bellamy","unstructured":"C. Hill, R. Bellamy, T. Erickson and M. Burnett, 2016. Trials and tribulations of developers of intelligent systems: A field study, 2016 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC), pp. 162--170, https:\/\/ieeexplore.ieee.org\/document\/7739680."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2011.11.001"},{"key":"e_1_3_2_1_26_1","first-page":"106","volume-title":"An Exploratory Study on Strategic Software Development Outsourcing. 2017 IEEE 12th International Conference on Global Software Engineering (ICGSE)","author":"Nie E.","year":"2017","unstructured":"Nie, E., & Hammouda, I., 2017. An Exploratory Study on Strategic Software Development Outsourcing. 2017 IEEE 12th International Conference on Global Software Engineering (ICGSE), pp. 106--115."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2017.11.135"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbusres.2019.01.044"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijinfomgt.2020.102225"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijinfomgt.2021.102383"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procir.2020.04.109"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.telpol.2020.101977"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEAA.2018.00018"},{"key":"e_1_3_2_1_34_1","unstructured":"Robert Feldt & Ana Magazinius 2010. 'Validity Threats in Empirical Software Engineering Research - An Initial Survey. SEKE (pp. 374--379)."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.9790\/487X-1336164"}],"event":{"name":"CAIN '22: 1st Conference on AI Engineering - Software Engineering for AI","location":"Pittsburgh Pennsylvania","acronym":"CAIN '22","sponsor":["SIGSOFT ACM Special Interest Group on Software Engineering","IEEE TCSC IEEE Technical Committee on Scalable Computing"]},"container-title":["Proceedings of the 1st International Conference on AI Engineering: Software Engineering for AI"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3522664.3528595","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3522664.3528595","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:34Z","timestamp":1750183774000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3522664.3528595"}},"subtitle":["towards selecting the optimal approach to conducting AI projects"],"short-title":[],"issued":{"date-parts":[[2022,5,16]]},"references-count":35,"alternative-id":["10.1145\/3522664.3528595","10.1145\/3522664"],"URL":"https:\/\/doi.org\/10.1145\/3522664.3528595","relation":{},"subject":[],"published":{"date-parts":[[2022,5,16]]},"assertion":[{"value":"2022-10-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}