{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T20:55:33Z","timestamp":1773176133441,"version":"3.50.1"},"reference-count":86,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2024,12,4]],"date-time":"2024-12-04T00:00:00Z","timestamp":1733270400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Italian Ministry of University and Research (MUR)","award":["L. 232\/2016"],"award-info":[{"award-number":["L. 232\/2016"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>Implementing machine learning technologies in manufacturing environment relies heavily on human expertise in terms of domain and machine learning knowledge. Yet, the required machine learning knowledge is often not available in manufacturing companies. A possible solution to overcome this competence gap and let domain experts with limited machine learning programming skills build viable applications are digital assistance systems that support the implementation. At the present, there is no comprehensive overview over corresponding assistance systems. Thus, within this study a systematic literature review based on the PRISMA-P process was conducted. Twenty-nine papers were identified and analyzed in depth regarding machine learning use case, required resources and research outlook. Six key findings as well as requirements for future developments are derived from the investigation. As such, the existing assistance systems basically focus on technical aspects whereas the integration of the users as well as validation in industrial environments lack behind. Future assistance systems should put more emphasis on the users and integrate them both in development and validation.<\/jats:p>","DOI":"10.3390\/make6040134","type":"journal-article","created":{"date-parts":[[2024,12,5]],"date-time":"2024-12-05T09:30:18Z","timestamp":1733391018000},"page":"2808-2828","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Digital Assistance Systems to Implement Machine Learning in Manufacturing: A Systematic Review"],"prefix":"10.3390","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0291-2671","authenticated-orcid":false,"given":"Jannik","family":"Rosemeyer","sequence":"first","affiliation":[{"name":"Institut for Production Management, Technology and Machine Tools, TU Darmstadt, Otto-Berndt-Stra\u00dfe 2, 64287 Darmstadt, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5629-6718","authenticated-orcid":false,"given":"Marta","family":"Pinzone","sequence":"additional","affiliation":[{"name":"Department of Management Engineering, Politecnico di Milano, Via Lambruschini 4b, 20156 Milan, Italy"}]},{"given":"Joachim","family":"Metternich","sequence":"additional","affiliation":[{"name":"Institut for Production Management, Technology and Machine Tools, TU Darmstadt, Otto-Berndt-Stra\u00dfe 2, 64287 Darmstadt, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2024,12,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"4773","DOI":"10.1080\/00207543.2021.1956675","article-title":"Machine learning in manufacturing and industry 4.0 applications","volume":"59","author":"Rai","year":"2021","journal-title":"Int. J. Prod. Res."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4361","DOI":"10.1080\/00207543.2021.2010979","article-title":"Editorial: Artificial Intelligence (AI) and data sharing in manufacturing, production and operations management research","volume":"60","author":"Papadopoulos","year":"2022","journal-title":"Int. J. Prod. Res."},{"key":"ref_3","unstructured":"Armutak, E.A., and Fendri, M. (2024, March 06). Unlocking Value from Artificial Intelligence in Manufacturing. Centre for the Fourth Industrial Revolution Turkey; World Economic Forum\u2019s Platform for Shaping. Available online: https:\/\/www3.weforum.org\/docs\/WEF_AI_in_Manufacturing_2022.pdf."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ermakova, T., Blume, J., Fabian, B., Fomenko, E., Berlin, M., and Hauswirth, M. (2021, January 5). Beyond the Hype: Why Do Data-Driven Projects Fail?. Proceedings of the 54th Hawaii International Conference on System Sciences, Kauai, HI, USA.","DOI":"10.24251\/HICSS.2021.619"},{"key":"ref_5","unstructured":"Metternich, J., Biegel, T., Bretones Cassoli, B., Hoffmann, F., Jourdan, N., Rosemeyer, J., Stanula, P., and Ziegenbein, A. (2024, March 06). K\u00fcnstliche Intelligenz zur Umsetzung von Industrie 4.0 im Mittelstand: Leitfaden zur Expertise des Forschungsbeirats der Plattform Industrie 4.0. Available online: https:\/\/www.acatech.de\/publikation\/fb4-0-ki-in-kmu\/download-pdf\/?lang=wildcard."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1016\/j.procir.2020.04.039","article-title":"Automated machine learning for predictive quality in production","volume":"93","author":"Pacheco","year":"2020","journal-title":"Procedia CIRP"},{"key":"ref_7","unstructured":"Biegel, T., Bretones Cassoli, B., Hoffmann, F., Jourdan, N., and Metternich, J. (2024, March 06). An AI Management Model for the Manufacturing Industry\u2014AIMM. Available online: https:\/\/hds.hebis.de\/ulbda\/Record\/HEB48543220X."},{"key":"ref_8","unstructured":"Bauer, M., van Dinther, C., and Kiefer, D. Machine learning in SME: An empirical study on enablers and success factors. Proceedings of the AMCIS 2020 Proceedings\u2014Advancings in Information Systems Research. 26th Americas Conference on Information Systems, online conference, 10\u201314 August 2020."},{"key":"ref_9","first-page":"702","article-title":"An AI adoption model for SMEs: A conceptual framework","volume":"54","author":"Bettoni","year":"2021","journal-title":"IFAC-Pap."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1007\/978-3-319-33747-0_51","article-title":"A Multi-horizon, Multi-objective Training Planner: Building the Skills for Manufacturing","volume":"Volume 54","author":"Bassis","year":"2016","journal-title":"Advances in Neural Networks. Computational Intelligence for ICT"},{"key":"ref_11","unstructured":"Trzcielinski, S. (2018). Collaborative Robots and New Product Introduction: Capturing and Transferring Human Expert Knowledge to the Operators. Advances in Ergonomics of Manufacturing: Managing the Enterprise of the Future, Springer International Publishing AG."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"952","DOI":"10.1080\/0951192X.2023.2278105","article-title":"Skills for Industry 4.0: A structured repository grounded on a generalized enterprise reference architecture and methodology-based framework","volume":"37","author":"Pinzone","year":"2023","journal-title":"Int. J. Comput. Integr. Manuf."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"898","DOI":"10.3390\/make6020042","article-title":"Concept Paper for a Digital Expert: Systematic Derivation of (Causal) Bayesian Networks Based on Ontologies for Knowledge-Based Production Steps","volume":"6","author":"Wenzel","year":"2024","journal-title":"Mach. Learn. Knowl. Extr."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Aggogeri, F., Pellegrini, N., and Tagliani, F.L. (2021). Recent Advances on Machine Learning Applications in Machining Processes. Appl. Sci., 11.","DOI":"10.3390\/app11188764"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1007\/s10462-023-10535-y","article-title":"A critical review on applications of artificial intelligence in manufacturing","volume":"56","author":"Mypati","year":"2023","journal-title":"Artif. Intell. Rev."},{"key":"ref_16","first-page":"276","article-title":"Overall Equipment Effectiveness-related Assembly Pattern Catalogue based on Machine Learning","volume":"23","author":"Dobra","year":"2023","journal-title":"Manuf. Technol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.procir.2020.01.040","article-title":"An approach for monitoring the execution of human based assembly operations using machine learning","volume":"86","author":"Andrianakos","year":"2019","journal-title":"Procedia CIRP"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1007\/s00170-022-09350-6","article-title":"An intelligent decision-making system for assembly process planning based on machine learning considering the variety of assembly unit and assembly process","volume":"121","author":"Zhang","year":"2022","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1889","DOI":"10.1007\/s00170-019-03988-5","article-title":"A review of machine learning for the optimization of production processes","volume":"104","author":"Weichert","year":"2019","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Mazzei, D., and Ramjattan, R. (2022). Machine Learning for Industry 4.0: A Systematic Review Using Deep Learning-Based Topic Modelling. Sensors, 22.","DOI":"10.3390\/s22228641"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1109\/THMS.2017.2717885","article-title":"A Symbiotic Human\u2013Machine Learning Approach for Production Ramp-up. IEEE Trans","volume":"48","author":"Doltsinis","year":"2018","journal-title":"Hum.-Mach. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Mhlanga, D. (2023). Artificial Intelligence and Machine Learning for Energy Consumption and Production in Emerging Markets: A Review. Energies, 16.","DOI":"10.3390\/en16020745"},{"key":"ref_23","unstructured":"Wirth, R., and Hipp, J. (2024, March 06). CRISP-DM: Towards a Standard Process Model for Data Mining. Available online: http:\/\/www.cs.unibo.it\/~montesi\/CBD\/Beatriz\/10.1.1.198.5133.pdf."},{"key":"ref_24","unstructured":"Azevedo, A., and Santos, M. (2008, January 22\u201327). KDD, SEMMA and CRISP-DM: A parallel overview. Proceedings of the IADIS European Conference on Data Mining, Amsterdam, The Netherlands."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1016\/j.procir.2019.02.106","article-title":"DMME: Data mining methodology for engineering applications\u2014A holistic extension to the CRISP-DM model","volume":"79","author":"Huber","year":"2019","journal-title":"Procedia CIRP"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"392","DOI":"10.3390\/make3020020","article-title":"Towards CRISP-ML(Q): A Machine Learning Process Model with Quality Assurance Methodology","volume":"3","author":"Studer","year":"2021","journal-title":"Mach. Learn. Knowl. Extr."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"51970","DOI":"10.1109\/ACCESS.2021.3069857","article-title":"ASML: Algorithm-Agnostic Architecture for Scalable Machine Learning","volume":"9","author":"Diamantis","year":"2021","journal-title":"IEEE Access"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"W\u00f6stmann, R., Schlunder, P., Temme, F., Klinkenberg, R., Kimberger, J., Spichtinger, A., Goldhacker, M., and Deuse, J. (2020, January 10\u201313). Conception of a Reference Architecture for Machine Learning in the Process Industry. Proceedings of the 2020 IEEE International Conference on Big Data, Atlanta, GA, USA.","DOI":"10.1109\/BigData50022.2020.9378290"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.future.2021.07.037","article-title":"Kafka-ML: Connecting the data stream with ML\/AI frameworks","volume":"126","author":"Langendoerfer","year":"2022","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Berthold, M.R., Cebron, N., Dill, F., Gabriel, T.R., K\u00f6tter, T., Meinl, T., Ohl, P., Sieb, C., Thiel, K., and Wiswedel, B. (2008). KNIME: The Konstanz Information Miner. Data Analysis, Machine Learning and Applications, Springer.","DOI":"10.1007\/978-3-540-78246-9_38"},{"key":"ref_31","unstructured":"Garner, S.R. (2024, March 06). WEKA: The Waikato Environment for Knowledge Analysis. Available online: https:\/\/citeseerx.ist.psu.edu\/document?repid=rep1&type=pdf&doi=b732d47f60ff8b3e0dbe09dd098578fb00a971f4."},{"key":"ref_32","first-page":"2349","article-title":"Orange: Data Mining Toolbox in Python","volume":"14","author":"Curk","year":"2013","journal-title":"J. Mach. Learn. Res."},{"key":"ref_33","unstructured":"Rosemeyer, J., Neunzig, C., Akbal, C., Metternich, J., and Kuhlenk\u00f6tter, B. (2024, July 10). A Maturity Model for Digital ML Tools to Be Used in Manufacturing Environments, Darmstadt. Available online: https:\/\/tuprints.ulb.tu-darmstadt.de\/26519\/1\/Rosemeyer%20et%20al._2024_A%20maturity%20model%20for%20digital%20ML%20tools%20to%20be%20used%20in%20manufacturing%20environments.pdf."},{"key":"ref_34","unstructured":"Apt, W., Schubert, M., and Wischmann, S. (2024, March 06). Digitale Assistenzsysteme: Perspektiven und Herausforderungen f\u00fcr den Einsatz in Industrie und Dienstleistungen. Available online: https:\/\/www.iit-berlin.de\/iit-docs\/fd2aa38ad4474e6cb53720e7878ffd4a_2018_02_01_Digitale_Assistenzsysteme_Perspektiven_und_Herausforderungen.pdf."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"3479","DOI":"10.1007\/s10845-023-02214-0","article-title":"ML Pro: Digital assistance system for interactive machine learning in production","volume":"35","author":"Neunzig","year":"2023","journal-title":"J. Intell. Manuf."},{"key":"ref_36","unstructured":"Kitchenham, B. (2024, March 06). Procedures for Performing Systematic Reviews. Available online: http:\/\/artemisa.unicauca.edu.co\/~ecaldon\/docs\/spi\/kitchenham_2004.pdf."},{"key":"ref_37","first-page":"n71","article-title":"The PRISMA 2020 statement: An updated guideline for reporting systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"BMJ (Clin. Res. Ed.)"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1465","DOI":"10.1002\/smj.722","article-title":"What passes as a rigorous case study?","volume":"29","author":"Gibbert","year":"2008","journal-title":"Strateg. Manag. J."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1581","DOI":"10.1007\/s10845-021-01771-6","article-title":"Applications of artificial intelligence in engineering and manufacturing: A systematic review","volume":"33","author":"Nti","year":"2022","journal-title":"J. Intell. Manuf."},{"key":"ref_40","unstructured":"Pumplun, L., Tauchert, C., and Heidt, M. (2019, January 8\u201314). A new organizational chassis for artifical intelligence: Exploring organizational readiness factors. Proceedings of the 27th European Conference on Information Systems (ECIS), Uppsala & Stockholm, Sweden."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s12599-020-00676-7","article-title":"Ready or Not, AI Comes\u2014 An Interview Study of Organizational AI Readiness Factors","volume":"63","author":"Wyrtki","year":"2021","journal-title":"Bus. Inf. Syst. Eng."},{"key":"ref_42","unstructured":"Hamm, P., and Klesel, M. (2021, January 9\u201313). Success Factors for the Adoption of Artiticial Intelligence in Organizations: A Literature Review. Proceedings of the AMCIS 2021 Proceedings\u2014Advancings in Information Systems Research, 27th Americas Conference on Information Systems, Association for Information Systems (AIS), Online."},{"key":"ref_43","unstructured":"Strohm, O., and Escher, O.P. (1997). Unternehmen Arbeitspsychologisch Bewerten: Ein Mehr-Ebenen-Ansatz Unter Besonderer Ber\u00fccksichtigung von Mensch, Technik und Organisation, vdf Hochschulverlag an der ETH Z\u00fcrich."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2579","DOI":"10.1109\/TMECH.2018.2834622","article-title":"A Cyber-Physical Production System Framework of Smart CNC Machining Monitoring System","volume":"23","author":"Zhu","year":"2018","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.jmsy.2017.02.011","article-title":"A fog computing-based framework for process monitoring and prognosis in cyber-manufacturing","volume":"43","author":"Wu","year":"2017","journal-title":"J. Manuf. Syst."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.procir.2018.03.215","article-title":"A framework to guide the selection and configuration of machine-learning-based data analytics solutions in manufacturing","volume":"72","author":"Reimann","year":"2018","journal-title":"Procedia CIRP"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"160","DOI":"10.26599\/BDMA.2018.9020016","article-title":"A generic data analytics system for manufacturing production","volume":"1","author":"Zhang","year":"2018","journal-title":"Big Data Min. Anal."},{"key":"ref_48","first-page":"311","article-title":"A Hybrid Machine Learning Approach for Predictive Maintenance in Smart Factories of the Future","volume":"Volume 536","author":"Moon","year":"2018","journal-title":"Advances in Production Management Systems. Smart Manufacturing for Industry 4.0"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.compind.2017.12.005","article-title":"A methodology for the semi-automatic generation of analytical models in manufacturing","volume":"95","author":"Lechevalier","year":"2018","journal-title":"Comput. Ind."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Cinar, E., Kalay, S., and Saricicek, I. (2022). A Predictive Maintenance System Design and Implementation for Intelligent Manufacturing. Machines, 10.","DOI":"10.3390\/machines10111006"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.jmsy.2018.02.001","article-title":"A systematic development method for cyber-physical machine tools","volume":"48","author":"Liu","year":"2018","journal-title":"J. Manuf. Syst."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1257","DOI":"10.1007\/s10845-019-01510-y","article-title":"An intelligent decision support system for production planning based on machine learning","volume":"31","year":"2020","journal-title":"J. Intell. Manuf."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Kranzer, S., Prill, D., Aghajanpour, D., Merz, R., Strasser, R., Mayr, R., Zoerrer, H., Plasch, M., and Steringer, R. (2017, January 22\u201325). An intelligent maintenance planning framework prototype for production systems. Proceedings of the 2017 IEEE International Conference on Industrial Technology (ICIT), Toronto, ON, Canada.","DOI":"10.1109\/ICIT.2017.7915520"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1117","DOI":"10.1016\/j.promfg.2020.10.157","article-title":"Architecture Model for a Holistic and Interoperable Digital Energy Management Platform","volume":"51","author":"Senna","year":"2020","journal-title":"Procedia Manuf."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1007\/s00170-020-06094-z","article-title":"CAAI\u2014A cognitive architecture to introduce artificial intelligence in cyber-physical production systems","volume":"111","author":"Fischbach","year":"2020","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"723","DOI":"10.1080\/0951192X.2019.1610578","article-title":"Cloud-based big data analytics platform using algorithm templates for the manufacturing industry","volume":"32","author":"Jun","year":"2019","journal-title":"Int. J. Comput. Integr. Manuf."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"103555","DOI":"10.1016\/j.compind.2021.103555","article-title":"Cognitive analytics platform with AI solutions for anomaly detection","volume":"134","author":"Rousopoulou","year":"2022","journal-title":"Comput. Ind."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1020","DOI":"10.1016\/j.promfg.2020.05.141","article-title":"Computer Vision Toolkit for Non-invasive Monitoring of Factory Floor Artifacts","volume":"48","author":"Deshpande","year":"2020","journal-title":"Procedia Manuf."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.promfg.2018.12.010","article-title":"Data analysis and visualization framework in the manufacturing decision support system of COMPOSITION project","volume":"28","author":"Vafeiadis","year":"2019","journal-title":"Procedia Manuf."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"2193","DOI":"10.1007\/s00170-018-2416-9","article-title":"Developing a big data analytics platform for manufacturing systems: Architecture, method, and implementation","volume":"99","author":"Woo","year":"2018","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_61","first-page":"128","article-title":"Expert System for the Machine Learning Pipeline in Manufacturing","volume":"54","author":"Frye","year":"2021","journal-title":"IFAC-Pap."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1016\/j.jmsy.2022.03.005","article-title":"Integrating human cognition in cyber-physical systems: A multidimensional fuzzy pattern model with application to thermal spraying","volume":"63","author":"Bocklisch","year":"2022","journal-title":"J. Manuf. Syst."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1007\/978-3-030-68527-0_8","article-title":"KOI: An Architecture and Framework for Industrial and Academic Machine Learning Applications","volume":"Volume 1341","author":"Simian","year":"2021","journal-title":"Modelling and Development of Intelligent Systems"},{"key":"ref_64","unstructured":"Magnotta, L., Gagliardelli, L., Simonini, G., Orsini, M., and Bergamaschi, S. (2018). MOMIS Dashboard: A powerful data analytics tool for Industry 4.0. Transdisciplinary Engineering Methods for Social Innovation of Industry 4.0. Proceedings of the 25th International Conference on Transdisciplinary Engineering, IOS Press."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1016\/j.jmsy.2018.04.019","article-title":"Patented intelligence: Cloning human decision models for Industry 4.0","volume":"48","author":"Terziyan","year":"2018","journal-title":"J. Manuf. Syst."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Heimes, H., Kampker, A., Buhrer, U., Steinberger, A., Eirich, J., and Krotil, S. (2019, January 18\u201319). Scalable Data Analytics from Predevelopment to Large Scale Manufacturing. Proceedings of the 2019 Asia Pacific Conference on Research in Industrial and Systems Engineering (APCoRISE), Depok, Indonesia.","DOI":"10.1109\/APCoRISE46197.2019.9318833"},{"key":"ref_67","first-page":"511","article-title":"Supporting Data Analytics in Manufacturing with a Digital Assistant","volume":"Volume 664","author":"Kim","year":"2022","journal-title":"Advances in Production Management Systems. Smart Manufacturing and Logistics Systems: Turning Ideas into Action"},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"100673","DOI":"10.1016\/j.iot.2022.100673","article-title":"Towards a cognitive assistant supporting human operators in the Artificial Intelligence of Things","volume":"21","author":"Angulo","year":"2023","journal-title":"Internet Things"},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.procir.2020.01.016","article-title":"Towards a connected factory: Shop-floor data analytics in cyber-physical environments","volume":"86","author":"Gyulai","year":"2019","journal-title":"Procedia CIRP"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"1169","DOI":"10.1007\/s00170-022-08761-9","article-title":"Towards big industrial data mining through explainable automated machine learning","volume":"120","author":"Garouani","year":"2022","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"1339","DOI":"10.1016\/j.procir.2018.03.136","article-title":"Validation of PERFoRM reference architecture demonstrating an application of data mining for predicting machine failure","volume":"72","author":"Chakravorti","year":"2018","journal-title":"Procedia CIRP"},{"key":"ref_72","unstructured":"Web of Science (2024, March 06). Analyze Results: AI OR \u201cArtificial Intelligence\u201d OR ML OR \u201cMachine Learning\u201d. Available online: https:\/\/www.webofscience.com\/wos\/woscc\/analyze-results\/f935061a-0d6c-407c-ab02-017786b1d759-d204f0dc."},{"key":"ref_73","doi-asserted-by":"crossref","unstructured":"\u0141api\u0144ska, J., Escher, I., G\u00f3rka, J., Sudolska, A., and Brzustewicz, P. (2021). Employees\u2019 Trust in Artificial Intelligence in Companies: The Case of Energy and Chemical Industries in Poland. Energies, 14.","DOI":"10.3390\/en14071942"},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Varsaluoma, J., V\u00e4\u00e4t\u00e4j\u00e4, H., Heimonen, T., Tiitinen, K., Hakulinen, J., Turunen, M., and Nieminen, H. (2018, January 10\u201311). Guidelines for Development and Evaluation of Usage Data Analytics Tools for Human-Machine Interactions with Industrial Manufacturing Systems. Proceedings of the 22nd International Academic Mindtrek Conference. Mindtrek 2018: Academic Mindtrek 2018, Tampere, Finland.","DOI":"10.1145\/3275116.3275138"},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"Blessing, L.T.M., and Chakrabarti, A. (2009). DRM, a Design Research Methodology, Springer.","DOI":"10.1007\/978-1-84882-587-1"},{"key":"ref_76","first-page":"7846","article-title":"Predictive maintenance for industry 5.0: Behavioural inquiries from a work system perspective","volume":"61","author":"Basten","year":"2022","journal-title":"Int. J. Prod. Res."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"4961","DOI":"10.1080\/00207543.2018.1492161","article-title":"A review of methodologies for integrating human factors and ergonomics in engineering design","volume":"57","author":"Sun","year":"2019","journal-title":"Int. J. Prod. Res."},{"key":"ref_78","unstructured":"International Organization for Standardization (2020). Ergonomics of Human System Interaction: Part 110: Dialogue Principles, International Organization for Standardization."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1007\/s10845-021-01796-x","article-title":"Human-centred design in industry 4.0: Case study review and opportunities for future research","volume":"33","author":"Lasa","year":"2022","journal-title":"J. Intell. Manuf."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"56","DOI":"10.3390\/make3010004","article-title":"AI System Engineering\u2014Key Challenges and Lessons Learned","volume":"3","author":"Fischer","year":"2021","journal-title":"Mach. Learn. Knowl. Extr."},{"key":"ref_81","first-page":"6847","article-title":"Human-centric artificial intelligence architecture for industry 5.0 applications","volume":"61","author":"Novalija","year":"2022","journal-title":"Int. J. Prod. Res."},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Stephanidis, C. (2019). Human-Centered Manufacturing Challenges Affecting European Industry 4.0 Enabling Technologies. HCI International 2019\u2014Late Breaking Papers, Springer Nature.","DOI":"10.1007\/978-3-030-30033-3"},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"593","DOI":"10.3390\/make6010028","article-title":"Augmenting Deep Neural Networks with Symbolic Educational Knowledge: Towards Trustworthy and Interpretable AI for Education","volume":"6","author":"Hooshyar","year":"2024","journal-title":"Mach. Learn. Knowl. Extr."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"78","DOI":"10.3390\/make5010006","article-title":"XAIR: A Systematic Metareview of Explainable AI (XAI) Aligned to the Software Development Process","volume":"5","author":"Clement","year":"2023","journal-title":"MAKE"},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"3605","DOI":"10.1007\/s10845-023-02304-z","article-title":"Survey on ontology-based explainable AI in manufacturing","volume":"35","author":"Naqvi","year":"2024","journal-title":"J. Intell. Manuf."},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"107803","DOI":"10.1016\/j.cie.2021.107803","article-title":"Augmented Workforce Canvas: A management tool for guiding human-centric, value-driven human-technology integration in industry","volume":"163","author":"Moencks","year":"2022","journal-title":"Comput. Ind. Eng."}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/6\/4\/134\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:46:21Z","timestamp":1760114781000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/6\/4\/134"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,4]]},"references-count":86,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["make6040134"],"URL":"https:\/\/doi.org\/10.3390\/make6040134","relation":{},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,4]]}}}