{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T05:42:06Z","timestamp":1771652526210,"version":"3.50.1"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,1,16]],"date-time":"2023-01-16T00:00:00Z","timestamp":1673827200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Manage. Inf. Syst."],"published-print":{"date-parts":[[2023,3,31]]},"abstract":"<jats:p>Artificial intelligence (AI) capabilities are increasingly common components of all socio-technical information systems that integrate human and machine actions. The impacts of AI components on the design and use of application systems are evolving rapidly as improved deep learning techniques and fresh big data sources afford effective and efficient solutions for broad ranges of applications. New goals and requirements for Human-AI System (HAIS) functions and qualities are emerging, whereas the boundaries between human and machine behaviors continue to blur. This research commentary identifies and addresses the design science research (DSR) challenges facing the field of Information Systems as the demand for human-machine synergies in Human-Artificial Intelligence Systems surges in all application areas. The design challenges of HAIS are characterized by a taxonomy of eight C's - composition, complexity, creativity, confidence, controls, conscience, certification, and contribution. By applying a design science research frame to structure and investigate HAIS design, implementation, use, and evolution, we propose a forward-thinking agenda for relevant and rigorous information systems research contributions.<\/jats:p>","DOI":"10.1145\/3549547","type":"journal-article","created":{"date-parts":[[2022,8,31]],"date-time":"2022-08-31T12:37:06Z","timestamp":1661949426000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Research Challenges for the Design of Human-Artificial Intelligence Systems (HAIS)"],"prefix":"10.1145","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4953-3900","authenticated-orcid":false,"given":"Alan","family":"Hevner","sequence":"first","affiliation":[{"name":"School of Information Systems and Management, Muma College of Business, University of South Florida"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8735-1553","authenticated-orcid":false,"given":"Veda","family":"Storey","sequence":"additional","affiliation":[{"name":"Computer Information Systems, J. Mack Robinson College of Business, Georgia State University"}]}],"member":"320","published-online":{"date-parts":[[2023,1,16]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2870052"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3519420"},{"issue":"1","key":"e_1_3_1_4_2","first-page":"123","article-title":"A model of creativity and innovation in organizations","volume":"10","author":"Amabile T. M.","year":"1988","unstructured":"T. M. Amabile. 1988. A model of creativity and innovation in organizations. Research in Organizational Behavior 10, 1 (1988), 123\u2013167.","journal-title":"Research in Organizational Behavior"},{"issue":"1","key":"e_1_3_1_5_2","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1002\/jocb.001","article-title":"Perspectives on the social psychology of creativity","volume":"46","author":"Amabile T. M.","year":"2012","unstructured":"T. M. Amabile and J. Pillemer. 2012. Perspectives on the social psychology of creativity. Journal of Creative Behavior 46, 1 (2012), 3\u201315.","journal-title":"Journal of Creative Behavior"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijinfomgt.2021.102433"},{"key":"e_1_3_1_7_2","doi-asserted-by":"crossref","DOI":"10.4135\/9781452274966","volume-title":"Information Systems Project Management","author":"Avison D.","year":"2009","unstructured":"D. Avison and G. Torkzadeh. 2009. Information Systems Project Management. Sage. 2009."},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.3233\/AO-200226"},{"issue":"5","key":"e_1_3_1_9_2","doi-asserted-by":"crossref","first-page":"3","DOI":"10.17705\/1jais.00495","article-title":"Design science research contributions: Finding a balance between artifact and theory","volume":"19","author":"Baskerville R.","year":"2018","unstructured":"R. Baskerville. 2018. Design science research contributions: Finding a balance between artifact and theory. Journal of the Association for Information Systems 19, 5 (2018), 3.","journal-title":"Journal of the Association for Information Systems"},{"key":"e_1_3_1_10_2","volume-title":"International Conference on Information Systems","author":"Baskerville R.","year":"2016","unstructured":"R. Baskerville. 2016. Bounded creativity in design science research. In International Conference on Information Systems, (2016)."},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.25300\/MISQ\/2015\/39.3.02"},{"key":"e_1_3_1_12_2","first-page":"1","article-title":"Expl (ai) n it to me\u2013explainable ai and information systems research","year":"2021","unstructured":"K. Bauer, O. Hinz, and W. van der Aalst. 2021. Expl (ai) n it to me\u2013explainable ai and information systems research. Business Information Systems Engineering, (2021). 1\u20134.","journal-title":"Business Information Systems Engineering"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3448250"},{"issue":"2","key":"e_1_3_1_14_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3210548","article-title":"Machine learning for the developing world","volume":"9","year":"2018","unstructured":"M. De-Arteaga, W. Herlands, D. Neill, and A. Dubrawski. 2018. Machine learning for the developing world. ACM Transactions on Management Information Systems 9, 2 (2018), 1\u201314.","journal-title":"ACM Transactions on Management Information Systems"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/2347736.2347755"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359786"},{"key":"e_1_3_1_17_2","volume-title":"2006 IEEE International Joint Conference on Neural Network Proceedings","author":"Duch W.","year":"2006","unstructured":"W. Duch. 2006. Computational creativity. In 2006 IEEE International Joint Conference on Neural Network Proceedings. IEEE."},{"key":"e_1_3_1_18_2","volume-title":"International Conference on Information Systems","author":"Durani K.","year":"2021","unstructured":"K. Durani, A. Eckhardt, and T. Kollmer. 2021. Towards ethical design science research. In International Conference on Information Systems. Association of Information Systems."},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1215\/07402775-3813015"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/2499962.2499963"},{"key":"e_1_3_1_21_2","doi-asserted-by":"crossref","first-page":"337","DOI":"10.25300\/MISQ\/2013\/37.2.01","article-title":"Positioning and presenting design science research for maximum impact","author":"Gregor S.","year":"2013","unstructured":"S. Gregor and A. R. Hevner. 2013. Positioning and presenting design science research for maximum impact. MIS Quarterly, (2013). 337\u2013355.","journal-title":"MIS Quarterly"},{"key":"e_1_3_1_22_2","first-page":"76","article-title":"Innovation's new math. Forget strategy lessons. To find one great idea, you must have workers dreaming up thousands","volume":"9","author":"Hamel G.","year":"2001","unstructured":"G. Hamel. 2001. Innovation's new math. Forget strategy lessons. To find one great idea, you must have workers dreaming up thousands. Fortune 9 (2001), 76\u201377.","journal-title":"Fortune"},{"key":"e_1_3_1_23_2","volume-title":"International Conference on Information Systesm","author":"Herwix A.","year":"2021","unstructured":"A. Herwix and P. zur Heiden. 2021. Context in design science research: Taxonomy and framework. In International Conference on Information Systesm."},{"issue":"1","key":"e_1_3_1_24_2","first-page":"iii","article-title":"Viewpoints on some genres of design science research: Intellectual control of complexity in design science research","volume":"41","author":"Hevner A.","year":"2017","unstructured":"A. Hevner. 2017. Viewpoints on some genres of design science research: Intellectual control of complexity in design science research. In Editor's comments: Diversity of design science research. MIS Quarterly 41, 1 (2017), iii\u2013xviii.","journal-title":"MIS Quarterly"},{"key":"e_1_3_1_25_2","first-page":"103350","article-title":"Envisioning entrepreneurship and digital innovation through a design science research lens: A matrix approach","author":"Hevner A.","year":"2021","unstructured":"A. Hevner and S. Gregor. 2021. Envisioning entrepreneurship and digital innovation through a design science research lens: A matrix approach. Information & Management (2021), 103350.","journal-title":"Information & Management"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.2307\/25148625"},{"key":"e_1_3_1_27_2","volume-title":"AIS SIGPrag Pre-ICIS Workshop on \u201cPractice-Based Design and Innovation of Digital Artifacts\u201d.","author":"Hevner A.","year":"2018","unstructured":"A. Hevner. 2018. A pragmatic approach for identifying and managing design science research goals and evaluation criteria. In AIS SIGPrag Pre-ICIS Workshop on \u201cPractice-Based Design and Innovation of Digital Artifacts\u201d."},{"key":"e_1_3_1_28_2","volume-title":"International Conference on Design Science Research in Information Systems and Technology","author":"Hevner A.","year":"2021","unstructured":"A. Hevner and V. C. Storey. 2021. Externalities of design science research: Preparation for project success. In International Conference on Design Science Research in Information Systems and Technology. Springer."},{"key":"e_1_3_1_29_2","volume-title":"The Sentient machine: The Coming Age of Artificial Intelligence","author":"Husain A.","year":"2017","unstructured":"A. Husain. 2017. The Sentient machine: The Coming Age of Artificial Intelligence, Simon and Schuster. (2017)."},{"key":"e_1_3_1_30_2","volume-title":"T-Minus AI: Humanity's Countdown to Artificial Intelligence and the New Pursuit of Global Power","author":"Kanaan M.","year":"2020","unstructured":"M. Kanaan. 2020. T-Minus AI: Humanity's Countdown to Artificial Intelligence and the New Pursuit of Global Power, BenBella Books. (2020)."},{"key":"e_1_3_1_31_2","volume-title":"The Ethical Algorithm: The Science of Socially Aware Algorithm Design","author":"Kearns M.","year":"2019","unstructured":"M. Kearns and A. Roth. 2019. The Ethical Algorithm: The Science of Socially Aware Algorithm Design. Oxford University Press."},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/219663.219677"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature14539"},{"issue":"2","key":"e_1_3_1_34_2","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1080\/12460125.2018.1529973","article-title":"Flow semantics for intellectual control in IoT systems","volume":"27","author":"Linger R. C.","year":"2018","unstructured":"R. C. Linger and A. R. Hevner. 2018. Flow semantics for intellectual control in IoT systems. Journal of Decision Systems 27, 2 (2018), 63\u201377.","journal-title":"Journal of Decision Systems"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2018.07.007"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.im.2014.01.002"},{"key":"e_1_3_1_37_2","volume-title":"Proceedings of the International Conference on Information Systems","author":"Rhue L.","year":"2019","unstructured":"L. Rhue. 2019. Beauty is in the AI of the Beholder: How Artificial Intelligence anchors human decisions on Subjective vs. Objective measures. In Proceedings of the International Conference on Information Systems."},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_3_1_39_2","volume-title":"Human Compatible: Artificial Intelligence and the Problem of Control","author":"Russell S.","year":"2019","unstructured":"S. Russell. 2019. Human Compatible: Artificial Intelligence and the Problem of Control. Penguin, (2019)."},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447507"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.25300\/MISQ\/2019\/13747"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2018.2889231"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3419764"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2020.1741118"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.17705\/1thci.00131"},{"key":"e_1_3_1_46_2","volume-title":"The Sciences of the Artificial","author":"Simon H. A.","year":"1996","unstructured":"H. A. Simon. 1996. The Sciences of the Artificial. MIT Press. (1996)."},{"key":"e_1_3_1_47_2","article-title":"Explanable AI: Opening the black box of Pandora's box?","author":"Storey V. C.","year":"2022","unstructured":"V. C. Storey, 2022. Explanable AI: Opening the black box of Pandora's box? Communications of the ACM, 2022.","journal-title":"Communications of the ACM"},{"issue":"1","key":"e_1_3_1_48_2","doi-asserted-by":"crossref","first-page":"96","DOI":"10.5465\/ame.2003.9474814","article-title":"Improving the creativity of organizational work groups","volume":"17","author":"Thompson L.","year":"2003","unstructured":"L. Thompson. 2003. Improving the creativity of organizational work groups. Academy of Management Perspectives 17, 1 (2003), 96\u2013109.","journal-title":"Academy of Management Perspectives"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1057\/ejis.2014.36"},{"issue":"3","key":"e_1_3_1_50_2","first-page":"9","article-title":"Special issue editorial\u2013accumulation and evolution of design knowledge in design science research: A journey through time and space","volume":"21","year":"2020","unstructured":"J. vom Brocke, R. Winter, A. Hevner, and A. Maedche. 2020. Special issue editorial\u2013accumulation and evolution of design knowledge in design science research: A journey through time and space. Journal of the Association for Information Systems 21, 3 (2020), 9.","journal-title":"Journal of the Association for Information Systems"},{"key":"e_1_3_1_51_2","article-title":"How AI detectives are craking open the black box of deep learning","author":"Voosen P.","year":"2017","unstructured":"P. Voosen. 2017. How AI detectives are craking open the black box of deep learning. Science (2017).","journal-title":"Science"},{"issue":"2","key":"e_1_3_1_52_2","first-page":"1","article-title":"Establishing data provenance for responsible Artificial Intelligence systems","volume":"13","author":"Werder K.","year":"2012","unstructured":"K. Werder, B. Ramesh, and R. Zhang. 2012. Establishing data provenance for responsible Artificial Intelligence systems. ACM Transactions on Management Information Systems (TMIS) 13, 2 (2022), 1\u201323.","journal-title":"ACM Transactions on Management Information Systems (TMIS)"},{"issue":"4","key":"e_1_3_1_53_2","first-page":"114","article-title":"Collaborative intelligence: Humans and AI are joining forces","volume":"96","author":"Wilson H. J.","year":"2018","unstructured":"H. J. Wilson and P. R. Daugherty. 2018. Collaborative intelligence: Humans and AI are joining forces. Harvard Business Review 96, 4 (2018), 114\u2013123.","journal-title":"Harvard Business Review"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3389685"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-018-05707-8"}],"container-title":["ACM Transactions on Management Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3549547","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3549547","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:00:11Z","timestamp":1750186811000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3549547"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,16]]},"references-count":54,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,3,31]]}},"alternative-id":["10.1145\/3549547"],"URL":"https:\/\/doi.org\/10.1145\/3549547","relation":{},"ISSN":["2158-656X","2158-6578"],"issn-type":[{"value":"2158-656X","type":"print"},{"value":"2158-6578","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,16]]},"assertion":[{"value":"2021-12-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-07-07","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-01-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}