{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T10:14:13Z","timestamp":1783764853847,"version":"3.55.0"},"reference-count":134,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,1,6]],"date-time":"2023-01-06T00:00:00Z","timestamp":1672963200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001602","name":"Science Foundation Ireland","doi-asserted-by":"publisher","award":["16\/RC\/3918"],"award-info":[{"award-number":["16\/RC\/3918"]}],"id":[{"id":"10.13039\/501100001602","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>The recent increase in computational capability has led to an unprecedented increase in the range of new applications where machine learning can be used in real time. Notwithstanding the range of use cases where automation is now feasible, humans are likely to retain a critical role in the operation and certification of manufacturing systems for the foreseeable future. This paper presents a use case review of how human operators affect the performance of cyber\u2013physical systems within a \u2019smart\u2019 or \u2019cognitive\u2019 setting. Such applications are classified using Industry 4.0 (I4.0) or 5.0 (I5.0) terminology. The authors argue that, as there is often no general agreement as to when a specific use case moves from being an I4.0 to an I5.0 example, the use of a hybrid Industry X.0 notation at the intersection between I4.0 and I5.0 is warranted. Through a structured review of the literature, the focus is on how secure human-mediated autonomous production can be performed most effectively to augment and optimise machine operation.<\/jats:p>","DOI":"10.3390\/systems11010035","type":"journal-article","created":{"date-parts":[[2023,1,9]],"date-time":"2023-01-09T04:47:08Z","timestamp":1673239628000},"page":"35","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":58,"title":["Human-in-Loop: A Review of Smart Manufacturing Deployments"],"prefix":"10.3390","volume":"11","author":[{"given":"Mangolika","family":"Bhattacharya","sequence":"first","affiliation":[{"name":"Department of Electronic and Computer Engineering, University of Limerick, V94 T9PX Limerick, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mihai","family":"Penica","sequence":"additional","affiliation":[{"name":"Department of Electronic and Computer Engineering, University of Limerick, V94 T9PX Limerick, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3173-140X","authenticated-orcid":false,"given":"Eoin","family":"O\u2019Connell","sequence":"additional","affiliation":[{"name":"Department of Electronic and Computer Engineering, University of Limerick, V94 T9PX Limerick, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark","family":"Southern","sequence":"additional","affiliation":[{"name":"School of Engineering and Enterprise Research Centre, University of Limerick, V94 T9PX Limerick, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martin","family":"Hayes","sequence":"additional","affiliation":[{"name":"Department of Electronic and Computer Engineering, University of Limerick, V94 T9PX Limerick, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1080\/00207543.2017.1351644","article-title":"Smart manufacturing","volume":"56","author":"Kusiak","year":"2018","journal-title":"Int. J. Prod. Res."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.jmsy.2016.03.001","article-title":"The evolution and future of manufacturing: A review","volume":"39","author":"Esmaeilian","year":"2016","journal-title":"J. Manuf. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.ifacol.2019.12.111","article-title":"Toward production operator 4.0: Modelling human-machine cooperation in industry 4.0 with cognitive work analysis","volume":"52","author":"Guerin","year":"2019","journal-title":"IFAC-PapersOnLine"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Longo, F., Padovano, A., and Umbrello, S. (2020). Value-oriented and ethical technology engineering in industry 5.0: A human-centric perspective for the design of the factory of the future. Appl. Sci., 10.","DOI":"10.3390\/app10124182"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Turner, C., Oyekan, J., Garn, W., Duggan, C., and Abdou, K. (2022). Industry 5.0 and the Circular Economy: Utilizing LCA with Intelligent Products. Sustainability, 14.","DOI":"10.3390\/su142214847"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1342","DOI":"10.1177\/0954405417736547","article-title":"Smart manufacturing: Characteristics, technologies and enabling factors","volume":"233","author":"Mittal","year":"2019","journal-title":"Proc. Inst. Mech. Eng. Part B J. Eng. Manuf."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"944","DOI":"10.1109\/COMST.2015.2398816","article-title":"A survey on human-in-the-loop applications towards an internet of all","volume":"17","author":"Nunes","year":"2015","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_8","unstructured":"Schaeffer, E. (2017). Industry X. 0: Realizing Digital Value in Industrial Sectors, Kogan Page Publishers."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Cheng, Y.J., Chen, M.H., Cheng, F.C., Cheng, Y.C., Lin, Y.S., and Yang, C.J. (2018). Developing a decision support system (DSS) for a dental manufacturing production line based on data mining. Appl. Syst. Innov., 1.","DOI":"10.3390\/asi1020017"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1016\/j.cie.2018.09.034","article-title":"Learning-based scheduling of flexible manufacturing systems using ensemble methods","volume":"126","author":"Priore","year":"2018","journal-title":"Comput. Ind. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"35365","DOI":"10.1109\/ACCESS.2018.2836950","article-title":"Machine learning and deep learning methods for cybersecurity","volume":"6","author":"Xin","year":"2018","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Gaham, M., Bouzouia, B., and Achour, N. (2015). Human-in-the-loop cyber-physical production systems control (hilcp 2 sc): A multi-objective interactive framework proposal. Service Orientation in Holonic and Multi-Agent Manufacturing, Springer.","DOI":"10.1007\/978-3-319-15159-5_29"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kujawi\u0144ska, A., Rogalewicz, M., Muchowski, M., and Sta\u0144kowska, M. (2018). Application of cluster analysis in making decision about purchase of additional materials for welding process. Smart Technology, Springer.","DOI":"10.1007\/978-3-319-73323-4_2"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/j.procir.2018.03.076","article-title":"Towards data mining based decision support in manufacturing maintenance","volume":"72","author":"Gandhi","year":"2018","journal-title":"Procedia CIRP"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1016\/j.jclepro.2016.07.123","article-title":"A big data analytics architecture for cleaner manufacturing and maintenance processes of complex products","volume":"142","author":"Zhang","year":"2017","journal-title":"J. Clean. Prod."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Antunes, R.A., and Palma, L.B. (July, January 1). Fitts\u2019 evaluation of a developed human-in-the-loop assistive device. Proceedings of the 2020 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Bari, Italy.","DOI":"10.1109\/MeMeA49120.2020.9137343"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"5573","DOI":"10.1109\/TIP.2014.2365952","article-title":"Learning multiple relative attributes with humans in the loop","volume":"23","author":"Qian","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2314","DOI":"10.1080\/00207179.2017.1342274","article-title":"Stability limit of human-in-the-loop model reference adaptive control architectures","volume":"91","author":"Yucelen","year":"2018","journal-title":"Int. J. Control"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"114060","DOI":"10.1016\/j.eswa.2020.114060","article-title":"Machine learning and data mining in manufacturing","volume":"166","author":"Dogan","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.cie.2017.09.016","article-title":"Smart operators in industry 4.0: A human-centered approach to enhance operators\u2019 capabilities and competencies within the new smart factory context","volume":"113","author":"Longo","year":"2017","journal-title":"Comput. Ind. Eng."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"105600","DOI":"10.1016\/j.cie.2018.12.047","article-title":"Exploring the potential of Operator 4.0 interface and monitoring","volume":"139","author":"Peruzzini","year":"2020","journal-title":"Comput. Ind. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.jmsy.2018.10.006","article-title":"Reference architectures for smart manufacturing: A critical review","volume":"49","author":"Moghaddam","year":"2018","journal-title":"J. Manuf. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1016\/j.jmsy.2020.01.002","article-title":"A human-in-the-loop manufacturing control architecture for the next generation of production systems","volume":"54","author":"Cimini","year":"2020","journal-title":"J. Manuf. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1016\/j.mfglet.2018.06.002","article-title":"Modeling agents as joint cognitive systems in smart manufacturing systems","volume":"17","author":"Jones","year":"2018","journal-title":"Manuf. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1177\/154193120304700138","article-title":"Beyond levels of automation: An architecture for more flexible human-automation collaboration","volume":"Volume 47","author":"Miller","year":"2003","journal-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1108\/AA-12-2013-036","article-title":"Cognitive automation strategy for reconfigurable and sustainable assembly systems","volume":"33","author":"Stahre","year":"2013","journal-title":"Assem. Autom."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1006\/ijhc.2000.0454","article-title":"Towards a cognitive approach to human\u2013machine cooperation in dynamic situations","volume":"54","author":"Hoc","year":"2001","journal-title":"Int. J. -Hum.-Comput. Stud."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/j.arcontrol.2019.03.004","article-title":"Enabling the human in the loop: Linked data and knowledge in industrial cyber-physical systems","volume":"47","author":"Emmanouilidis","year":"2019","journal-title":"Annu. Rev. Control"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1214\/aoms\/1177704711","article-title":"The future of data analysis","volume":"33","author":"Tukey","year":"1962","journal-title":"Ann. Math. Stat."},{"key":"ref_30","unstructured":"Tukey, J.W. (1977). Exploratory Data Analysis, Sage."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Idreos, S., Papaemmanouil, O., and Chaudhuri, S. (June, January 31). Overview of data exploration techniques. Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data, Melbourne, Australia.","DOI":"10.1145\/2723372.2731084"},{"key":"ref_32","unstructured":"Cook, K.A., and Thomas, J.J. (2005). Illuminating the Path: The Research and Development Agenda for Visual Analytics, Technical Report."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1007\/s10844-014-0304-9","article-title":"The human is the loop: New directions for visual analytics","volume":"43","author":"Endert","year":"2014","journal-title":"J. Intell. Inf. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.ifacol.2016.11.038","article-title":"Context-based and human-centred information fusion in diagnostics","volume":"49","author":"Emmanouilidis","year":"2016","journal-title":"IFAC-PapersOnLine"},{"key":"ref_35","unstructured":"Breque, M., Nul, L.D., and Petridis, A. (2021). Industry 5.0, Towards a Sustainable, Human-Centric and Resilient European Industry, Publications Office of European Union."},{"key":"ref_36","unstructured":"Trist, E.L. (1981). The Evolution of Socio-Technical Systems, Ontario Quality of Working Life Centre Toronto."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Schmidt, R., M\u00f6hring, M., H\u00e4rting, R.C., Reichstein, C., Neumaier, P., and Jozinovi\u0107, P. (2015, January 24\u201326). Industry 4.0-potentials for creating smart products: Empirical research results. Proceedings of the International Conference on Business Information Systems, Poznan, Poland.","DOI":"10.1007\/978-3-319-19027-3_2"},{"key":"ref_38","first-page":"55","article-title":"The impact of industry 4.0 on procurement and supply management: A conceptual and qualitative analysis","volume":"5","author":"Glas","year":"2016","journal-title":"Int. J. Bus. Manag. Invent."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1184","DOI":"10.1016\/j.proeng.2014.03.108","article-title":"The smart factory: Exploring adaptive and flexible manufacturing solutions","volume":"69","author":"Radziwon","year":"2014","journal-title":"Procedia Eng."},{"key":"ref_40","unstructured":"Llena-Nozal, A., Martin, N., and Murtin, F. (2019). The Economy of Well-Being: Creating Opportunities for People\u2019s Well-Being and Economic Growth, Organization for Economic Cooperation and Development (OECD)."},{"key":"ref_41","first-page":"2015","article-title":"Sustainable development goals","volume":"2030","author":"Assembly","year":"2015","journal-title":"SDGs Transform. Our World"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Romero, D., Bernus, P., Noran, O., Stahre, J., and Fast-Berglund, \u00c5. (2016, January 3\u20136). The operator 4.0: Human cyber-physical systems & adaptive automation towards human-automation symbiosis work systems. Proceedings of the IFIP International Conference on Advances in Production Management Systems, Iguassu Falls, Brazil.","DOI":"10.1007\/978-3-319-51133-7_80"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Salaken, S.M., Nahavandi, S., McGinn, C., Hossny, M., Kelly, K., Abobakr, A., Nahavandi, D., and Iskander, J. (2019, January 23\u201325). Development of a cloud-based computational framework for an empathetic robot. Proceedings of the 2019 11th International Conference on Computer and Automation Engineering, Perth, Australia.","DOI":"10.1145\/3313991.3314018"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"612","DOI":"10.1016\/j.jmsy.2022.02.001","article-title":"Outlook on human-centric manufacturing towards Industry 5.0","volume":"62","author":"Lu","year":"2022","journal-title":"J. Manuf. Syst."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1142\/S2424862220500141","article-title":"Critical components of Industry 5.0 towards a successful adoption in the field of manufacturing","volume":"5","author":"Javaid","year":"2020","journal-title":"J. Ind. Integr. Manag."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1016\/j.procir.2019.03.162","article-title":"A human-in-the-loop cyber-physical system for collaborative assembly in smart manufacturing","volume":"81","author":"Garcia","year":"2019","journal-title":"Procedia CIRP"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1016\/S0377-2217(98)00062-9","article-title":"Integration of the human operator into responsive discrete production management systems","volume":"109","author":"Trentesaux","year":"1998","journal-title":"Eur. J. Oper. Res."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.jmsy.2016.05.002","article-title":"Combined strength of holons, agents and function blocks in cyber-physical systems","volume":"40","author":"Wang","year":"2016","journal-title":"J. Manuf. Syst."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Bhattacharya, M., Mohandas, R., Penica, M., Southern, M., Van Camp, K., and Hayes, M.J. (2021, January 23\u201325). Analysis of the Message Queueing Telemetry Transport Protocol for Data Labelling: An Orthopedic Manufacturing Process Case Study. Proceedings of the IoTBDS, Online.","DOI":"10.5220\/0010450402150222"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"3159805","DOI":"10.1155\/2016\/3159805","article-title":"Implementing Smart Factory of Industrie 4.0: An Outlook","volume":"12","author":"Wang","year":"2016","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Fantini, P., Tavola, G., Taisch, M., Barbosa, J., Leit\u00e3o, P., Liu, Y., Sayed, M.S., and Lohse, N. (2016, January 23\u201326). Exploring the integration of the human as a flexibility factor in CPS enabled manufacturing environments: Methodology and results. Proceedings of the IECON 2016-42nd Annual Conference of the IEEE Industrial Electronics Society, Florence, Italy.","DOI":"10.1109\/IECON.2016.7793579"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1605","DOI":"10.1080\/1352816031000074964","article-title":"Extended structured adaptive supervisory control model of shop floor controls for an e-Manufacturing system","volume":"41","author":"Qiu","year":"2003","journal-title":"Int. J. Prod. Res."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Jugulum, R. (2016). Importance of data quality for analytics. Quality in the 21st Century, Springer.","DOI":"10.1007\/978-3-319-21332-3_2"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1016\/j.promfg.2017.07.198","article-title":"A review of the roles of digital twin in CPS-based production systems","volume":"11","author":"Negri","year":"2017","journal-title":"Procedia Manuf."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1332","DOI":"10.1080\/09537287.2017.1375148","article-title":"Data-driven operations management: Organisational implications of the digital transformation in industrial practice","volume":"28","author":"Fritzsche","year":"2017","journal-title":"Prod. Plan. Control"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.apergo.2016.01.009","article-title":"Categorisation of visualisation methods to support the design of Human-Computer Interaction Systems","volume":"55","author":"Li","year":"2016","journal-title":"Appl. Ergon."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"e5722","DOI":"10.1002\/cpe.5722","article-title":"Approaching human vision perception to designing visual graph in data visualization","volume":"33","author":"Tran","year":"2021","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1007\/s12650-018-0530-2","article-title":"A survey of visualization for smart manufacturing","volume":"22","author":"Zhou","year":"2019","journal-title":"J. Vis."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/MIS.2017.49","article-title":"Manufacturing analytics and industrial internet of things","volume":"32","author":"Lade","year":"2017","journal-title":"IEEE Intell. Syst."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1177\/1473871619858933","article-title":"A model-driven approach to automate data visualization in big data analytics","volume":"19","author":"Golfarelli","year":"2020","journal-title":"Inf. Vis."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.cola.2019.03.002","article-title":"Visualization approaches for understanding uncertainty in flow diagrams","volume":"52","author":"Vosough","year":"2019","journal-title":"J. Comput. Lang."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1109\/TKDE.2020.2981464","article-title":"Steerable self-driving data visualization","volume":"34","author":"Luo","year":"2020","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/j.cola.2019.01.002","article-title":"Research on context of implicit context-sensitive graph grammars","volume":"51","author":"Zou","year":"2019","journal-title":"J. Comput. Lang."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"5468","DOI":"10.1109\/TCYB.2020.2970198","article-title":"Genetic programming for evolving a front of interpretable models for data visualization","volume":"51","author":"Lensen","year":"2020","journal-title":"IEEE Trans. Cybern."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.cola.2019.01.004","article-title":"Visualization and analysis of schema and instances of ontologies for improving user tasks and knowledge discovery","volume":"51","author":"Silva","year":"2019","journal-title":"J. Comput. Lang."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Fuller, A., Fan, Z., and Day, C. (2019). Digital twin: Enabling technology, challenges and open research. arXiv.","DOI":"10.1109\/ACCESS.2020.2998358"},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"101837","DOI":"10.1016\/j.rcim.2019.101837","article-title":"Digital Twin-driven smart manufacturing: Connotation, reference model, applications and research issues","volume":"61","author":"Lu","year":"2020","journal-title":"Robot. -Comput.-Integr. Manuf."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"882","DOI":"10.1109\/THMS.2016.2596099","article-title":"Discrete event simulation and virtual reality use in industry: New opportunities and future trends","volume":"46","author":"Turner","year":"2016","journal-title":"IEEE Trans. -Hum.-Mach. Syst."},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Hutabarat, W., Oyekan, J., Turner, C., Tiwari, A., Prajapat, N., Gan, X.P., and Waller, A. (2016, January 11\u201314). Combining virtual reality enabled simulation with 3D scanning technologies towards smart manufacturing. Proceedings of the 2016 Winter Simulation Conference (WSC), Washington, DC, USA.","DOI":"10.1109\/WSC.2016.7822314"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s00170-015-7702-1","article-title":"Visualization of RFID-enabled shopfloor logistics Big Data in Cloud Manufacturing","volume":"84","author":"Zhong","year":"2016","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"103130","DOI":"10.1016\/j.compind.2019.103130","article-title":"Review of digital twin applications in manufacturing","volume":"113","author":"Cimino","year":"2019","journal-title":"Comput. Ind."},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.mfglet.2018.02.006","article-title":"Digital twin\u2013Proof of concept","volume":"15","author":"Haag","year":"2018","journal-title":"Manuf. Lett."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"3563","DOI":"10.1007\/s00170-017-0233-1","article-title":"Digital twin-driven product design, manufacturing and service with big data","volume":"94","author":"Tao","year":"2018","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1016\/j.procir.2016.11.152","article-title":"The digital twin: Realizing the cyber-physical production system for industry 4.0","volume":"61","author":"Uhlemann","year":"2017","journal-title":"Procedia CIRP"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.jmsy.2019.10.001","article-title":"Enabling technologies and tools for digital twin","volume":"58","author":"Qi","year":"2021","journal-title":"J. Manuf. Syst."},{"key":"ref_76","doi-asserted-by":"crossref","unstructured":"Fortino, G., Guerrieri, A., Pace, P., Savaglio, C., and Spezzano, G. (2022). IoT Platforms and Security: An Analysis of the Leading Industrial\/Commercial Solutions. Sensors, 22.","DOI":"10.3390\/s22062196"},{"key":"ref_77","doi-asserted-by":"crossref","unstructured":"Karmakar, A., Dey, N., Baral, T., Chowdhury, M., and Rehan, M. (2019, January 18\u201320). Industrial internet of things: A review. Proceedings of the 2019 International Conference on Opto-Electronics and Applied Optics (Optronix), Kolkata, India.","DOI":"10.1109\/OPTRONIX.2019.8862436"},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Petrik, D., and Herzwurm, G. (2019, January 26). iIoT ecosystem development through boundary resources: A Siemens MindSphere case study. Proceedings of the 2nd ACM SIGSOFT International Workshop on Software-Intensive Business: Start-Ups, Platforms, and Ecosystems, Tallinn, Estonia.","DOI":"10.1145\/3340481.3342730"},{"key":"ref_79","doi-asserted-by":"crossref","unstructured":"Jedermann, R., Lang, W., Geyer, M., and Mahajan, P. (2022, January 23\u201325). Digital Twin Features for the Intelligent Container. Proceedings of the International Conference on Dynamics in Logistics, Bremen, Germany.","DOI":"10.1007\/978-3-031-05359-7_18"},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Labani, M., Beheshti, A., Lovell, N.H., Alinejad-Rokny, H., and Afrasiabi, A. (2022). KARAJ: An Efficient Adaptive Multi-Processor Tool to Streamline Genomic and Transcriptomic Sequence Data Acquisition. Int. J. Mol. Sci., 23.","DOI":"10.3390\/ijms232214418"},{"key":"ref_81","doi-asserted-by":"crossref","unstructured":"Leskovsk\u1ef3, R., Ku\u010dera, E., Haffner, O., and Rosinov\u00e1, D. (February, January 29). Proposal of digital twin platform based on 3D rendering and IIoT principles using virtual\/augmented reality. Proceedings of the 2020 Cybernetics & Informatics (K&I), Velke Karlovice, Czech Republic.","DOI":"10.1109\/KI48306.2020.9039804"},{"key":"ref_82","unstructured":"Singh, G. (2022, August 30). Baker Hughes Develops Predictive Maintenance Software for Gas and Oil Extraction Equipment Using Data Analytics and Machine Learning. Available online: https:\/\/www.mathworks.com\/company\/user_stories\/baker-hughes-develops-predictive-maintenance-software-for-gas-and-oil-extraction-equipment-using-data-analytics-and-machine-learning.html."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"1217","DOI":"10.1007\/s12652-018-0687-5","article-title":"A simulation-based approach for plant layout design and production planning","volume":"10","author":"Zhang","year":"2019","journal-title":"J. Ambient. Intell. Humaniz. Comput."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1007\/s12046-012-0062-8","article-title":"A review of designing machine tool for leanness","volume":"37","author":"Gupta","year":"2012","journal-title":"Sadhana"},{"key":"ref_85","doi-asserted-by":"crossref","unstructured":"Gorecky, D., Schmitt, M., Loskyll, M., and Z\u00fchlke, D. (2014, January 27\u201330). Human-machine-interaction in the industry 4.0 era. Proceedings of the 2014 12th IEEE International Conference on Industrial Informatics (INDIN), Porto Alegre, Brazil.","DOI":"10.1109\/INDIN.2014.6945523"},{"key":"ref_86","unstructured":"Hadorn, B., Courant, M., and Hirsbrunner, B. (2016). Towards Human-Centered Cyber-Physical Systems, D\u00e9partment d\u2019informatique Universit\u00e9 de Fribourg."},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"105471","DOI":"10.1016\/j.cie.2018.10.032","article-title":"Smart and cognitive solutions for Operator 4.0: Laboratory H-CPPS case studies","volume":"139","author":"Papcun","year":"2020","journal-title":"Comput. Ind. Eng."},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"302161","DOI":"10.1155\/ASP.2005.2375","article-title":"Vision Systems with the Human in the Loop","volume":"2005","author":"Bauckhage","year":"2005","journal-title":"Eurasip J. Adv. Signal Process."},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"Lv, Z., Poiesi, F., Dong, Q., Lloret, J., and Song, H. (2022). Deep Learning for Intelligent Human\u2013Computer Interaction. Appl. Sci., 12.","DOI":"10.3390\/app122211457"},{"key":"ref_90","unstructured":"Herrmann, T., and Pfeiffer, S. (2022). Keeping the organization in the loop: A socio-technical extension of human-centered artificial intelligence. AI Soc., 1\u201320. Available online: https:\/\/link.springer.com\/article\/10.1007\/s00146-022-01391-5."},{"key":"ref_91","first-page":"28","article-title":"Identifying critical contextual design cues through a machine learning approach","volume":"40","author":"Cummings","year":"2019","journal-title":"AI Mag."},{"key":"ref_92","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3418034","article-title":"Subjectivity in the creation of machine learning models","volume":"13","author":"Cummings","year":"2021","journal-title":"ACM J. Data Inf. Qual."},{"key":"ref_93","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.jss.2016.02.010","article-title":"Engineering context-aware systems and applications: A survey","volume":"117","author":"Alegre","year":"2016","journal-title":"J. Syst. Softw."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/s12652-009-0004-4","article-title":"Towards a new human-centred computing methodology for cooperative ambient intelligence","volume":"1","author":"Gross","year":"2010","journal-title":"J. Ambient. Intell. Humaniz. Comput."},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1007\/s11036-017-0810-4","article-title":"The internet of things supporting context-aware computing: A cultural heritage case study","volume":"22","author":"Piccialli","year":"2017","journal-title":"Mob. Netw. Appl."},{"key":"ref_96","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/JIOT.2017.2773600","article-title":"Context-aware computing, learning, and big data in internet of things: A survey","volume":"5","author":"Sezer","year":"2017","journal-title":"IEEE Internet Things J."},{"key":"ref_97","doi-asserted-by":"crossref","unstructured":"Gil, D., Ferr\u00e1ndez, A., Mora-Mora, H., and Peral, J. (2016). Internet of things: A review of surveys based on context aware intelligent services. Sensors, 16.","DOI":"10.3390\/s16071069"},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1016\/j.knosys.2016.04.020","article-title":"Towards latent context-aware recommendation systems","volume":"104","author":"Unger","year":"2016","journal-title":"Knowl.-Based Syst."},{"key":"ref_99","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1080\/0951192X.2015.1130257","article-title":"A concept for context-aware computing in manufacturing: The white goods case","volume":"29","author":"Alexopoulos","year":"2016","journal-title":"Int. J. Comput. Integr. Manuf."},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"105732","DOI":"10.1016\/j.cie.2019.02.046","article-title":"Intelligent assistant system as a context-aware decision-making support for the workers of the future","volume":"139","author":"Belkadi","year":"2020","journal-title":"Comput. Ind. Eng."},{"key":"ref_101","doi-asserted-by":"crossref","first-page":"103950","DOI":"10.1109\/ACCESS.2021.3099311","article-title":"Human in the Loop: Industry 4.0 technologies and scenarios for worker mediation of automated manufacturing","volume":"9","author":"Turner","year":"2021","journal-title":"IEEE Access"},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"1027","DOI":"10.1109\/JPROC.2020.2977054","article-title":"Embodied self-aware computing systems","volume":"108","author":"Hoffmann","year":"2020","journal-title":"Proc. IEEE"},{"key":"ref_103","unstructured":"Dellermann, D., Calma, A., Lipusch, N., Weber, T., Weigel, S., and Ebel, P. (2021). The future of human-AI collaboration: A taxonomy of design knowledge for hybrid intelligence systems. arXiv."},{"key":"ref_104","doi-asserted-by":"crossref","unstructured":"Barredo-Arrieta, A., La\u00f1a, I., and Del Ser, J. (2019, January 27\u201329). What lies beneath: A note on the explainability of black-box machine learning models for road traffic forecasting. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, NZ, USA.","DOI":"10.1109\/ITSC.2019.8916985"},{"key":"ref_105","unstructured":"Cush, A. (2022, August 30). This Program That Judges Use to Predict Future Crimes Seems Racist as Hell. Available online: https:\/\/www.gawker.com\/this-program-that-judges-use-to-predict-future-crimes-s-1778151070."},{"key":"ref_106","first-page":"10","article-title":"Fake news detection: A deep learning approach","volume":"1","author":"Thota","year":"2018","journal-title":"SMU Data Sci. Rev."},{"key":"ref_107","doi-asserted-by":"crossref","first-page":"101647","DOI":"10.1016\/j.techsoc.2021.101647","article-title":"An alliance of humans and machines for machine learning: Hybrid intelligent systems and their design principles","volume":"66","author":"Ostheimer","year":"2021","journal-title":"Technol. Soc."},{"key":"ref_108","doi-asserted-by":"crossref","first-page":"618","DOI":"10.1017\/lst.2019.5","article-title":"Re-engineering justice? Robot judges, computerised courts and (semi) automated legal decision-making","volume":"39","author":"Morison","year":"2019","journal-title":"Leg. Stud."},{"key":"ref_109","doi-asserted-by":"crossref","first-page":"5031","DOI":"10.1109\/TII.2022.3146552","article-title":"From artificial intelligence to explainable artificial intelligence in industry 4.0: A survey on what, how, and where","volume":"18","author":"Ahmed","year":"2022","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_110","unstructured":"Correia, A.H., and Lecue, F. (2019, January 27\u201328). Human-in-the-loop feature selection. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_111","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1613\/jair.1.11345","article-title":"Human-in-the-loop artificial intelligence","volume":"64","author":"Zanzotto","year":"2019","journal-title":"J. Artif. Intell. Res."},{"key":"ref_112","first-page":"7026","article-title":"Making Better Use of the Crowd: How Crowdsourcing Can Advance Machine Learning Research","volume":"18","author":"Vaughan","year":"2017","journal-title":"J. Mach. Learn. Res."},{"key":"ref_113","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s40708-016-0042-6","article-title":"Interactive machine learning for health informatics: When do we need the human-in-the-loop?","volume":"3","author":"Holzinger","year":"2016","journal-title":"Brain Inform."},{"key":"ref_114","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1007\/s40708-016-0036-4","article-title":"An adaptive annotation approach for biomedical entity and relation recognition","volume":"3","author":"Yimam","year":"2016","journal-title":"Brain Inform."},{"key":"ref_115","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s10676-017-9430-8","article-title":"Society-in-the-loop: Programming the algorithmic social contract","volume":"20","author":"Rahwan","year":"2018","journal-title":"Ethics Inf. Technol."},{"key":"ref_116","unstructured":"Roser, C., Nakano, M., and Tanaka, M. (2001, January 9\u201312). A practical bottleneck detection method. Proceedings of the 2001 Winter Simulation Conference (Cat. No. 01CH37304), Arlington, VA, USA."},{"key":"ref_117","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.jmsy.2020.02.011","article-title":"A generic hierarchical clustering approach for detecting bottlenecks in manufacturing","volume":"55","author":"Subramaniyan","year":"2020","journal-title":"J. Manuf. Syst."},{"key":"ref_118","first-page":"225","article-title":"Data-driven algorithm for throughput bottleneck analysis of production systems","volume":"6","author":"Subramaniyan","year":"2018","journal-title":"Prod. Manuf. Res."},{"key":"ref_119","doi-asserted-by":"crossref","unstructured":"Yu, C., and Matta, A. (2014, January 18\u201322). Data-driven bottleneck detection in manufacturing systems: A statistical approach. Proceedings of the 2014 IEEE International Conference on Automation Science and Engineering (CASE), New Taipei, Taiwan.","DOI":"10.1109\/CoASE.2014.6899406"},{"key":"ref_120","doi-asserted-by":"crossref","unstructured":"Havur, G., Haselb\u00f6ck, A., and Cabanillas, C. (2019, January 1\u20136). Automated multi-perspective process generation in the manufacturing domain. Proceedings of the International Conference on Business Process Management, Vienna, Austria.","DOI":"10.1007\/978-3-030-37453-2_8"},{"key":"ref_121","doi-asserted-by":"crossref","first-page":"666","DOI":"10.1016\/j.procs.2021.01.289","article-title":"Smart factory security: A case study on a modular smart manufacturing system","volume":"180","author":"Maggi","year":"2021","journal-title":"Procedia Comput. Sci."},{"key":"ref_122","doi-asserted-by":"crossref","first-page":"971","DOI":"10.3390\/fi4040971","article-title":"The cousins of stuxnet: Duqu, flame, and gauss","volume":"4","author":"Felegyhazi","year":"2012","journal-title":"Future Internet"},{"key":"ref_123","unstructured":"Baksi, R.P. (2022). Framework and Strategies to Mitigate Advanced. [Ph.D. Thesis, State University of New York]."},{"key":"ref_124","unstructured":"Baksi, R.P., and Upadhyaya, S.J. (2017). Kidemonas: The silent guardian. arXiv."},{"key":"ref_125","unstructured":"Times, N. (The New York Times, 2012). Saudi Oil Producer\u2019s Computers Restored After Virus Attack, The New York Times."},{"key":"ref_126","doi-asserted-by":"crossref","first-page":"897","DOI":"10.1007\/s10796-020-10087-4","article-title":"Decepticon: A Theoretical Framework to Counter Advanced Persistent Threats","volume":"23","author":"Baksi","year":"2021","journal-title":"Inf. Syst. Front."},{"key":"ref_127","unstructured":"Research, T.M. (2021). What We Know About the DarkSide Ransomware and the US Pipeline Attack. Trend Micro, Available online: https:\/\/www.trendmicro.com\/en_ca\/research\/21\/e\/what-we-know-about-darkside-ransomware-and-the-us-pipeline-attac.html."},{"key":"ref_128","unstructured":"Eaton, C., and Volz, D. (2021). Colonial Pipeline CEO Tells Why He Paid Hackers a $4.4 Million Ransom. Wall Str. J., Available online: https:\/\/www.wsj.com\/articles\/colonial-pipeline-ceo-tells-why-he-paid-hackers-a-4-4-million-ransom-11621435636."},{"key":"ref_129","doi-asserted-by":"crossref","unstructured":"Baksi, R.P. (2022, January 27\u201330). Pay or Not Pay? A Game-Theoretical Analysis of Ransomware Interactions Considering a Defender\u2019s Deception Architecture. Proceedings of the 2022 52nd Annual IEEE\/IFIP International Conference on Dependable Systems and Networks-Supplemental Volume (DSN-S), Baltimore, MD, USA. Available online: https:\/\/ieeexplore.ieee.org\/document\/9833759\/authors#authors.","DOI":"10.1109\/DSN-S54099.2022.00030"},{"key":"ref_130","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/S1353-4858(20)30079-9","article-title":"The 2020 Data Breach Investigations Report\u2013a CSO\u2019s perspective","volume":"2020","author":"Jartelius","year":"2020","journal-title":"Netw. Secur."},{"key":"ref_131","doi-asserted-by":"crossref","first-page":"1111","DOI":"10.1007\/s10845-017-1315-5","article-title":"Detecting cyber-physical attacks in CyberManufacturing systems with machine learning methods","volume":"30","author":"Wu","year":"2019","journal-title":"J. Intell. Manuf."},{"key":"ref_132","doi-asserted-by":"crossref","unstructured":"Salloum, S.A., Alshurideh, M., Elnagar, A., and Shaalan, K. (2020, January 8\u201310). Machine learning and deep learning techniques for cybersecurity: A review. Proceedings of the International Conference on Artificial Intelligence and Computer Vision, Cairo, Egypt.","DOI":"10.1007\/978-3-030-44289-7_5"},{"key":"ref_133","doi-asserted-by":"crossref","unstructured":"Elfar, M., Zhu, H., Raghunathan, A., Tay, Y.Y., Wubbenhorst, J., Cummings, M.L., and Pajic, M. (2017, January 18\u201321). Platform for security-aware design of human-on-the-loop cyber-physical systems. Proceedings of the 8th International Conference on Cyber-Physical Systems, Pittsburgh, PA, USA.","DOI":"10.1145\/3055004.3064846"},{"key":"ref_134","first-page":"20190029","article-title":"Visualization and explainable machine learning for efficient manufacturing and system operations","volume":"2","author":"Le","year":"2019","journal-title":"Smart Sustain. Manuf. Syst."}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/11\/1\/35\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:02:11Z","timestamp":1760119331000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/11\/1\/35"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,6]]},"references-count":134,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["systems11010035"],"URL":"https:\/\/doi.org\/10.3390\/systems11010035","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,6]]}}}