{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,11]],"date-time":"2026-02-11T13:58:00Z","timestamp":1770818280124,"version":"3.50.1"},"reference-count":46,"publisher":"Cambridge University Press (CUP)","license":[{"start":{"date-parts":[[2022,2,9]],"date-time":"2022-02-09T00:00:00Z","timestamp":1644364800000},"content-version":"unspecified","delay-in-days":39,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"funder":[{"name":"National Science and Technology Innovation 2030 Major Project","award":["2018AAA0100703"],"award-info":[{"award-number":["2018AAA0100703"]}]},{"name":"Ministry of Science and Technology of China and the Provincial Key Research and Development Plan of Zhejiang Province","award":["No. 2019C03137"],"award-info":[{"award-number":["No. 2019C03137"]}]}],"content-domain":{"domain":["cambridge.org"],"crossmark-restriction":true},"short-container-title":["AIEDAM"],"published-print":{"date-parts":[[2022]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Machine learning (ML) is increasingly used to enhance intelligent products in the field of product design. However, ML has a never-ending lifecycle in which its capabilities and technical properties iteratively change as new annotated data are utilized. The never-ending lifecycle of ML (which includes data annotation, model training, and other steps) has led to challenges to the prototyping of ML-enhanced products and requires a high level of ML literacy in designers. To facilitate the prototyping of ML-enhanced products and improve the ML literacy of designers, we draw inspiration from a design method called Material Lifecycle Thinking (MLT), which regards ML as a continuously evolving design material. Based on the MLT, we proposed a cyclical prototype workflow and developed inML Kit, a toolkit enabling designers to make functional ML prototypes and improve ML literacy by involving them in the never-ending ML lifecycle. The toolkit was designed, iterated, and implemented through the participatory design process with experienced designers in this field. We evaluated inML Kit by conducting a controlled user study where our toolkit was compared with Google AIY. The evaluation results imply that our inML Kit helps designers to make functional ML prototypes while improving their ML literacy.<\/jats:p>","DOI":"10.1017\/s0890060421000391","type":"journal-article","created":{"date-parts":[[2022,2,9]],"date-time":"2022-02-09T08:45:14Z","timestamp":1644396314000},"update-policy":"https:\/\/doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":5,"title":["inML Kit: empowering the prototyping of ML-enhanced products by involving designers in the ML lifecycle"],"prefix":"10.1017","volume":"36","author":[{"given":"Lingyun","family":"Sun","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuyang","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhuoshu","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zihong","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9545-3763","authenticated-orcid":false,"given":"Zhibin","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"56","published-online":{"date-parts":[[2022,2,9]]},"reference":[{"key":"S0890060421000391_ref31","doi-asserted-by":"publisher","DOI":"10.1109\/ICMLA.2015.152"},{"key":"S0890060421000391_ref35","first-page":"01","article-title":"Developing a toolkit for prototyping machine learning-empowered products: the design and evaluation of ML-rapid","volume":"14","author":"Sun","year":"2020","journal-title":"International Journal of Design"},{"key":"S0890060421000391_ref38","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-005-0026-7"},{"key":"S0890060421000391_ref33","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/52.3-4.591"},{"key":"S0890060421000391_ref21","doi-asserted-by":"publisher","DOI":"10.1145\/1375761.1375762"},{"key":"S0890060421000391_ref30","unstructured":"Raspberry Pi Foundation (2021) Teach, Learn, and Make with Raspberry Pi. Raspberry Pi. Available at https:\/\/www.raspberrypi.org\/."},{"key":"S0890060421000391_ref45","first-page":"1","article-title":"ML lifecycle canvas: designing machine learning-empowered UX with material lifecycle thinking","author":"Zhou","year":"2020","journal-title":"Human\u2013Computer Interaction"},{"key":"S0890060421000391_ref4","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v35i4.2513"},{"key":"S0890060421000391_ref14","unstructured":"Google (2019) Do-it-yourself artificial intelligence. Available at https:\/\/aiyprojects.withgoogle.com\/."},{"key":"S0890060421000391_ref20","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173610"},{"key":"S0890060421000391_ref18","first-page":"15","article-title":"The (New) roles of prototypes during the co-development of digital product service systems","volume":"14","author":"Kleinsmann","year":"2020","journal-title":"International Journal of Design"},{"key":"S0890060421000391_ref9","unstructured":"Davis, FD (1985) A Technology Acceptance Model for Empirically Testing New End-user Information Systems: Theory and Results (Thesis). Massachusetts Institute of Technology. Available at https:\/\/dspace.mit.edu\/handle\/1721.1\/15192."},{"key":"S0890060421000391_ref5","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300233"},{"key":"S0890060421000391_ref39","first-page":"289","article-title":"Analyzing opportunities for using interactive augmented prototyping in design practice","volume":"23","author":"Verlinden","year":"2009","journal-title":"AI EDAM"},{"key":"S0890060421000391_ref26","doi-asserted-by":"publisher","DOI":"10.1145\/153571.255960"},{"key":"S0890060421000391_ref40","unstructured":"Yang, Q (2017) The role of design in creating machine-learning-enhanced user experience. 2017 AAAI Spring Symposia."},{"key":"S0890060421000391_ref43","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196730"},{"key":"S0890060421000391_ref46","doi-asserted-by":"publisher","DOI":"10.1145\/3274463"},{"key":"S0890060421000391_ref3","doi-asserted-by":"publisher","DOI":"10.1145\/2451176.2451230"},{"key":"S0890060421000391_ref27","doi-asserted-by":"publisher","DOI":"10.20982\/tqmp.04.1.p013"},{"key":"S0890060421000391_ref12","doi-asserted-by":"publisher","DOI":"10.1145\/604045.604056"},{"key":"S0890060421000391_ref41","unstructured":"Yang, Q (2018) Machine learning as a UX design material: how can we imagine beyond automation, recommenders, and reminders? 2018 AAAI Spring Symposium."},{"key":"S0890060421000391_ref42","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173704"},{"key":"S0890060421000391_ref23","doi-asserted-by":"publisher","DOI":"10.1145\/1150402.1150531"},{"key":"S0890060421000391_ref13","unstructured":"Fiebrink, R and Cook, PR (2010) The Wekinator: A System for Real-Time, Interactive Machine Learning in Music. Proceedings of The Eleventh International Society for Music Information Retrieval Conference (IS-MIR 2010)."},{"key":"S0890060421000391_ref28","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357160"},{"key":"S0890060421000391_ref44","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376301"},{"key":"S0890060421000391_ref11","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025739"},{"key":"S0890060421000391_ref6","doi-asserted-by":"publisher","DOI":"10.1017\/dsj.2017.10"},{"key":"S0890060421000391_ref29","doi-asserted-by":"publisher","DOI":"10.1109\/MWENT.2018.8337236"},{"key":"S0890060421000391_ref1","unstructured":"Abadi, M , Barham, P , Chen, J , Chen, Z , Davis, A , Dean, J , Devin, M , Ghemawat, S , Irving, G , Isard, M , Kudlur, M , Levenberg, J , Monga, R , Moore, S , Murray, DG , Steiner, B , Tucker, P , Vasudevan, V , Warden, P and Zheng, X (2016) TensorFlow: A System for Large-Scale Machine Learning, pp. 265\u2013283. Available at https:\/\/www.usenix.org\/conference\/osdi16\/technical-sessions\/presentation\/abadi."},{"key":"S0890060421000391_ref7","unstructured":"Cerejo, J and Carvalhais, M (2019) Design after the Rise of AI-Driven Services: Learning from Literature Review. DIGICOM International Conference on Digital Design & Communication, Barcelos, Portugal."},{"key":"S0890060421000391_ref24","doi-asserted-by":"publisher","DOI":"10.1016\/j.adhoc.2012.02.016"},{"key":"S0890060421000391_ref19","volume-title":"Designing and Conducting Focus Group Interviews: Notes","author":"Krueger","year":"1998"},{"key":"S0890060421000391_ref16","unstructured":"Intel (2018) Intel\u00ae Movidius\u2122 Neural Compute Stick. Intel. Available at https:\/\/www.intel.com\/content\/www\/us\/en\/develop\/articles\/intel-movidius-neural-compute-stick.html."},{"key":"S0890060421000391_ref10","doi-asserted-by":"publisher","DOI":"10.1145\/2347736.2347755"},{"key":"S0890060421000391_ref32","unstructured":"Richert, W and Coelho, LP (2013) Building machine learning systems with Python: master the art of machine learning with Python and build effective machine learning systems with this intensive hands-on guide. Packt Publ."},{"key":"S0890060421000391_ref34","unstructured":"Spencer, D and Warfel, T (2004) Card Sorting: A Definitive Guide. Boxes and Arrows. Available at https:\/\/boxesandarrows.com\/card-sorting-a-definitive-guide\/."},{"key":"S0890060421000391_ref36","doi-asserted-by":"crossref","DOI":"10.4135\/9781526435477","volume-title":"A Hybrid Approach to Thematic Analysis in Qualitative Research: Using a Practical Example","author":"Swain","year":"2018"},{"key":"S0890060421000391_ref37","doi-asserted-by":"publisher","DOI":"10.1145\/3274566"},{"key":"S0890060421000391_ref8","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v39i3.2815"},{"key":"S0890060421000391_ref2","volume-title":"Introduction to Machine Learning","author":"Alpaydin","year":"2020"},{"key":"S0890060421000391_ref15","doi-asserted-by":"publisher","DOI":"10.1017\/S0890060498122047"},{"key":"S0890060421000391_ref17","doi-asserted-by":"publisher","DOI":"10.1145\/357417.357420"},{"key":"S0890060421000391_ref22","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376727"},{"key":"S0890060421000391_ref25","doi-asserted-by":"publisher","DOI":"10.1145\/319382.319388"}],"container-title":["Artificial Intelligence for Engineering Design, Analysis and Manufacturing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S0890060421000391","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,26]],"date-time":"2023-01-26T10:10:13Z","timestamp":1674727813000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S0890060421000391\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"references-count":46,"alternative-id":["S0890060421000391"],"URL":"https:\/\/doi.org\/10.1017\/s0890060421000391","relation":{},"ISSN":["0890-0604","1469-1760"],"issn-type":[{"value":"0890-0604","type":"print"},{"value":"1469-1760","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022]]},"assertion":[{"value":"Copyright \u00a9 The Author(s), 2022. Published by Cambridge University Press","name":"copyright","label":"Copyright","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}}],"article-number":"e8"}}