{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T14:50:08Z","timestamp":1785509408553,"version":"3.56.0"},"reference-count":80,"publisher":"Emerald","issue":"1","license":[{"start":{"date-parts":[[2020,2,3]],"date-time":"2020-02-03T00:00:00Z","timestamp":1580688000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["INTR"],"published-print":{"date-parts":[[2020,2,23]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title><jats:p>This article reports the results from a panel discussion held at the 2019 European Conference on Information Systems (ECIS) on the use of technology-based autonomous agents in collaborative work.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title><jats:p>The panelists (Drs Izak Benbasat, Paul Benjamin Lowry, Stefan Morana, and Stefan Seidel) presented ideas related to affective and cognitive implications of using autonomous technology-based agents in terms of (1) emotional connection with these agents, (2) decision-making, and (3) knowledge and learning in settings with autonomous agents. These ideas provided the basis for a moderated panel discussion (the moderators were Drs Isabella Seeber and Lena Waizenegger), during which the initial position statements were elaborated on and additional issues were raised.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title><jats:p>Through the discussion, a set of additional issues were identified. These issues related to (1) the design of autonomous technology-based agents in terms of human\u2013machine workplace configurations, as well as transparency and explainability, and (2) the unintended consequences of using autonomous technology-based agents in terms of de-evolution of social interaction, prioritization of machine teammates, psychological health, and biased algorithms.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title><jats:p>Key issues related to the affective and cognitive implications of using autonomous technology-based agents, design issues, and unintended consequences highlight key contemporary research challenges that allow researchers in this area to leverage compelling questions that can guide further research in this field.<\/jats:p><\/jats:sec>","DOI":"10.1108\/intr-12-2019-0503","type":"journal-article","created":{"date-parts":[[2020,2,25]],"date-time":"2020-02-25T06:14:36Z","timestamp":1582611276000},"page":"1-18","source":"Crossref","is-referenced-by-count":86,"title":["Collaborating with technology-based autonomous agents"],"prefix":"10.1108","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8246-8974","authenticated-orcid":false,"given":"Isabella","family":"Seeber","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2975-4135","authenticated-orcid":false,"given":"Lena","family":"Waizenegger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefan","family":"Seidel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefan","family":"Morana","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Izak","family":"Benbasat","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul Benjamin","family":"Lowry","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"140","reference":[{"key":"key2020042711474955700_ref001","unstructured":"Adams, J.A., DeLoach, S.A. and Scheutz, M. (2014), \u201cShared mental models for human-robot teams\u201d, AAAI Fall Symposium - Technical Report, Vol. FS-14\u201301, pp. 5-6."},{"issue":"2","key":"key2020042711474955700_ref002","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1111\/j.1540-5915.2008.00189.x","article-title":"The effects of process and outcome similarity on users' evaluations of decision aids","volume":"39","year":"2008","journal-title":"Decision Sciences"},{"issue":"1","key":"key2020042711474955700_ref003","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1057\/s41265-016-0032-4","article-title":"Partners of humans: a realistic assessment of the role of robots in the foreseeable future","volume":"32","year":"2017","journal-title":"Journal of Information Technology"},{"key":"key2020042711474955700_ref004","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/j.chb.2018.03.051","article-title":"Living up to the chatbot hype: the influence of anthropomorphic design cues and communicative agency framing on conversational agent and company perceptions","volume":"85","year":"2018","journal-title":"Computers in Human Behavior"},{"issue":"1","key":"key2020042711474955700_ref005","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/1529100619832930","article-title":"Emotional expressions reconsidered: challenges to inferring emotion from human facial movements","volume":"20","year":"2019","journal-title":"Psychological Science in the Public Interest"},{"issue":"September 2019","key":"key2020042711474955700_ref006","first-page":"56","article-title":"The role of demographic similarity in people's decision to interact with online anthropomorphic recommendation agents: evidence from a functional magnetic resonance imaging (fMRI) study","volume":"133","year":"2020","journal-title":"Journal of Human Computer Studies"},{"key":"key2020042711474955700_ref007","first-page":"4","article-title":"Social augmentation of enterprise communication systems for virtual teams using chatbots","year":"2019"},{"key":"key2020042711474955700_ref008","first-page":"194","article-title":"Multimodal backchannels for embodied conversational agents","year":"2010"},{"issue":"2","key":"key2020042711474955700_ref009","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1145\/1067860.1067867","article-title":"Establishing and maintaining long-term human- computer relationships","volume":"12","year":"2005","journal-title":"ACM Transactions on Computer-Human Interaction"},{"key":"key2020042711474955700_ref010","doi-asserted-by":"publisher","DOI":"10.1155\/2016\/8569602","article-title":"Robotic seals as therapeutic tools in an aged care facility: a qualitative study","volume":"2016","year":"2016","journal-title":"Journal of Aging Research"},{"issue":"2","key":"key2020042711474955700_ref011","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1017\/jmo.2016.55","article-title":"Smart technology, artificial intelligence, robotics, and algorithms (STARA): employees' perceptions of our future workplace","volume":"24","year":"2018","journal-title":"Journald of Management & Organization"},{"issue":"6370","key":"key2020042711474955700_ref012","doi-asserted-by":"crossref","first-page":"1530","DOI":"10.1126\/science.aap8062","article-title":"What can machine learning do? Workforce implications","volume":"358","year":"2017","journal-title":"Science"},{"key":"key2020042711474955700_ref013","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.ijhcs.2016.02.002","article-title":"Application of expectancy violations theory to communication with and judgments about embodied agents during a decision-making task","volume":"91","year":"2016","journal-title":"International Journal of Human-Computer Studies"},{"issue":"5","key":"key2020042711474955700_ref014","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1080\/10447318.2016.1150643","article-title":"Exploring the effect of avatar trust on learners' perceived participation intentions in an e-learning environment exploring the effect of avatar trust on learners' perceived participation intentions in an e-learning environment","volume":"32","year":"2016","journal-title":"International Journal of Human-Computer Interaction"},{"key":"key2020042711474955700_ref015","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1016\/j.chb.2015.12.039","article-title":"Co-constructing intersubjectivity with artificial conversational agents: people are more likely to initiate repairs of misunderstandings with agents represented as human","volume":"58","year":"2016","journal-title":"Computers in Human Behavior"},{"key":"key2020042711474955700_ref016","unstructured":"Darling, K. (2016), \u201cExtending legal protection to social robots\u201d, in Calo, R., Froomkin, M.A. and Kerr, I. (Eds), Robot Law, Edward Elgar Publishing, pp. 213-234."},{"issue":"6","key":"key2020042711474955700_ref017","first-page":"58","article-title":"Beyond Automation: strategies for remaining gainfully employed in an era of very smart machines","volume":"93","year":"2015","journal-title":"Harvard Business Review"},{"issue":"3","key":"key2020042711474955700_ref018","first-page":"57306","article-title":"Just how smart are smart machines?","volume":"57","year":"2016","journal-title":"MIT Sloan Management Review"},{"key":"key2020042711474955700_ref019","first-page":"1","article-title":"Algorithm aversion: people erroneously avoid algorithms after seeing them err","volume":"144","year":"2015","journal-title":"Academy of Management Proceedings"},{"key":"key2020042711474955700_ref020","first-page":"105","article-title":"When a computer speaks institutional talk: exploring challenges and potentials of virtual assistants in face-to-face advisory services","year":"2019"},{"issue":"4","key":"key2020042711474955700_ref021","doi-asserted-by":"crossref","first-page":"864","DOI":"10.1037\/0033-295X.114.4.864","article-title":"On seeing human: a three-factor theory of anthropomorphism","volume":"114","year":"2007","journal-title":"Psychological Review"},{"key":"key2020042711474955700_ref022","article-title":"Ethics guidelines for trustworthy AI","author":"European Commission","year":"2019"},{"key":"key2020042711474955700_ref023","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1016\/j.ijhcs.2019.07.009","article-title":"A taxonomy of social cues for conversational agents","volume":"132","year":"2019","journal-title":"International Journal of Human-Computer Studies"},{"issue":"3","key":"key2020042711474955700_ref024","first-page":"143","article-title":"A survey of socially interactive robots: concepts, design, and applications","volume":"42","year":"2003","journal-title":"Robotics and Autonomous Systems"},{"issue":"June","key":"key2020042711474955700_ref025","first-page":"84","article-title":"When your boss wears metal pants","year":"2015","journal-title":"Harvard Business Review"},{"key":"key2020042711474955700_ref026","unstructured":"Gibbs, S. (2015), \u201cWomen less likely to be shown ads for high-paid jobs on google, study shows\u201d, The Guardian, July 2014, pp. 2014-2016."},{"issue":"6206","key":"key2020042711474955700_ref027","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1126\/science.1259439","article-title":"Amplify scientific discovery with artificial intelligence","volume":"346","year":"2014","journal-title":"Science"},{"key":"key2020042711474955700_ref028","first-page":"23","article-title":"Faster is not always better: understanding the effect of dynamic response delays in human-chatbot interaction","year":"2018"},{"key":"key2020042711474955700_ref029","article-title":"Towards designing cooperative and social conversational agents for customer service","year":"2017"},{"issue":"4","key":"key2020042711474955700_ref030","doi-asserted-by":"crossref","first-page":"497","DOI":"10.2307\/249487","article-title":"Explanations from intelligent systems: theoretical foundations and implications for practice","volume":"23","year":"1999","journal-title":"MIS Quartely"},{"key":"key2020042711474955700_ref031","first-page":"1","article-title":"Chatbots, humbots, and the quest for artificial general intelligence","volume-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems","year":"2019"},{"key":"key2020042711474955700_ref032","doi-asserted-by":"publisher","DOI":"10.1109\/36.210458","article-title":"Explainable artificial intelligence (xai)","year":"2016","journal-title":"Defense Advanced Research Projects Agency, DARPA\/I20"},{"issue":"1","key":"key2020042711474955700_ref033","first-page":"1","article-title":"Using artificial intelligence to set information free","volume":"58","year":"2016","journal-title":"MIT Sloan Management Review"},{"key":"key2020042711474955700_ref034","doi-asserted-by":"publisher","article-title":"Two's company, three's a crowd? The role of a recommendation agent in collaborative online shopping","year":"2017","DOI":"10.2139\/ssrn.3045619"},{"key":"key2020042711474955700_ref035","unstructured":"Israni, E.T. (2017), \u201cWhen an algorithm helps send you to prison\u201d, The New York Times, pp. 1-3."},{"key":"key2020042711474955700_ref036","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.chb.2017.09.022","article-title":"Did the risk of exposure to online hate increase after the November 2015 Paris attacks? A group relations approach","volume":"78","year":"2018","journal-title":"Computers in Human Behavior"},{"issue":"3","key":"key2020042711474955700_ref037","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/S0378-7206(00)00062-8","article-title":"A process model cognitive biasing effects in information systems development and usage","volume":"38","year":"2001","journal-title":"Information & Management"},{"issue":"May 2016","key":"key2020042711474955700_ref038","first-page":"95","article-title":"Enhancing user experience with conversational agent for movie recommendation: effects of self-disclosure and reciprocity","volume":"103","year":"2017","journal-title":"International Journal of Human-Computer Studies"},{"issue":"3","key":"key2020042711474955700_ref039","doi-asserted-by":"crossref","first-page":"863","DOI":"10.1080\/07421222.2017.1373012","article-title":"Using IT design to prevent cyberbullying","volume":"34","year":"2017","journal-title":"Journal of Management Information Systems"},{"issue":"4","key":"key2020042711474955700_ref040","doi-asserted-by":"crossref","first-page":"962","DOI":"10.1287\/isre.2016.0671","article-title":"Why do adults engage in cyberbullying on social media? An integration of online disinhibition and deindividuation effects with the social structure and social learning model","volume":"27","year":"2016","journal-title":"Information Systems Research"},{"key":"key2020042711474955700_ref041","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1007\/s12599-019-00600-8","article-title":"AI-based digital assistants: Opportunities, threats, and research perspectives","volume":"4","year":"2019","journal-title":"Business and Information Systems Engineering"},{"issue":"4","key":"key2020042711474955700_ref042","first-page":"34","article-title":"How human-computer \u2018superminds\u2019 are redefining the future of work","volume":"59","year":"2018","journal-title":"MIT Sloan Management Review"},{"key":"key2020042711474955700_ref043","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.ijhcs.2005.07.001","article-title":"\u201cConstructing computer-based tutors that are socially sensitive: politeness in educational software\u201d","volume":"64","year":"2006","journal-title":"International Journal of Human-Computer Studies"},{"key":"key2020042711474955700_ref044","first-page":"1","article-title":"Cognitive bias in machine learning: the high stakes game of digital discrimination","year":"2018"},{"issue":"1","key":"key2020042711474955700_ref045","first-page":"1","article-title":"User perceptions of anthropomorphic robots as monitoring devices","volume":"30","year":"2013","journal-title":"AI & Society"},{"key":"key2020042711474955700_ref046","article-title":"Explanation in human-AI systems: a literature meta-review synopsis of key ideas and publications and bibliography for explainable AI","year":"2019"},{"issue":"3","key":"key2020042711474955700_ref047","doi-asserted-by":"crossref","first-page":"125","DOI":"10.17705\/1jais.00048","article-title":"Knowledge-based support in a group decision making context: an expert-novice comparison","volume":"5","year":"2004","journal-title":"Journal of the Association for Information Systems"},{"issue":"1","key":"key2020042711474955700_ref048","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1111\/0022-4537.00153","article-title":"Machines and mindlessness: social responses to computers","volume":"56","year":"2000","journal-title":"Journal of Social Issues"},{"key":"key2020042711474955700_ref049","first-page":"228","article-title":"Can computer personalities be human personalities?","year":"1995"},{"key":"key2020042711474955700_ref050","first-page":"4915","article-title":"Talking to bots: symbiotic agency and the case of Tay","volume":"10","year":"2016","journal-title":"IIternational Journal of Communication"},{"issue":"1","key":"key2020042711474955700_ref051","doi-asserted-by":"crossref","first-page":"145","DOI":"10.2307\/25148721","article-title":"Incorporating software agents into supply chains: experimental investigation with a procurement Task1","volume":"30","year":"2006","journal-title":"MIS Quarterly"},{"key":"key2020042711474955700_ref052","article-title":"OpenAI Charter","author":"OpenAI","year":"2018"},{"key":"key2020042711474955700_ref053","doi-asserted-by":"crossref","first-page":"100943","DOI":"10.1109\/ACCESS.2019.2929050","article-title":"Emotion recognition in conversation: research challenges, datasets, and recent advances","volume":"7","year":"2019","journal-title":"IEEE Access"},{"issue":"6","key":"key2020042711474955700_ref054","doi-asserted-by":"crossref","first-page":"859","DOI":"10.1177\/0890117118824196","article-title":"Positive and negative experiences on social media and perceived social isolation","volume":"33","year":"2019","journal-title":"American Journal of Health Promotion"},{"issue":"4","key":"key2020042711474955700_ref055","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1145\/1121112.1121113","article-title":"An investigation into the effects of text-to-speech voice and 3D avatars on the perception of presence and flow of live help in electronic commerce","volume":"12","year":"2005","journal-title":"ACM Transactions on Computer-Human Interaction"},{"issue":"4","key":"key2020042711474955700_ref056","doi-asserted-by":"crossref","first-page":"145","DOI":"10.2753\/MIS0742-1222250405","article-title":"Evaluating anthropomorphic product recommendation agents: a social relationship perspective to designing information systems","volume":"25","year":"2009","journal-title":"Journal of Management Information Systems"},{"issue":"10","key":"key2020042711474955700_ref057","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1016\/j.ijhcs.2010.05.005","article-title":"A study of demographic embodiments of product recommendation agents in electronic commerce","volume":"68","year":"2010","journal-title":"Journal of Human Computer Studies"},{"issue":"1","key":"key2020042711474955700_ref058","first-page":"iii","article-title":"Editor's comments: next-generation digital platforms: toward human\u2013AI hybrids","volume":"43","year":"2019","journal-title":"MIS Quarterly"},{"issue":"1","key":"key2020042711474955700_ref059","first-page":"1","article-title":"Reshaping business with artificial intelligence","volume":"59","year":"2017","journal-title":"MIT Sloan Management Review"},{"issue":"1","key":"key2020042711474955700_ref060","first-page":"2942","article-title":"Robots and avatars as hosts, advisors, companions, and jesters","volume":"30","year":"2017","journal-title":"AI Magazine"},{"key":"key2020042711474955700_ref061","first-page":"1","article-title":"Put AI in the human loop martha","year":"2019"},{"key":"key2020042711474955700_ref062","doi-asserted-by":"publisher","volume-title":"Artificial Intelligence: A Modern Approach","year":"2016","DOI":"10.1017\/s0269888900007724"},{"issue":"5","key":"key2020042711474955700_ref063","doi-asserted-by":"crossref","first-page":"1166","DOI":"10.1108\/IntR-10-2018-442","article-title":"The dark side of social media \u2013 and Fifty Shades of Grey introduction to the special issue: the dark side of social media","volume":"28","year":"2018","journal-title":"Internet Research"},{"key":"key2020042711474955700_ref064","doi-asserted-by":"publisher","volume-title":"Explainable AI: Interpreting, Explaining and Visualizing Deep Learning","year":"2019","DOI":"10.1007\/978-3-030-28954-6"},{"key":"key2020042711474955700_ref065","volume-title":"The Fourth Industrial Revolution","year":"2017"},{"issue":"2","key":"key2020042711474955700_ref066","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.im.2019.103174","article-title":"Machines as teammates: a research agenda on AI in team collaboration","volume":"57","year":"2019","journal-title":"Information & Management, Elsevier publishing company"},{"key":"key2020042711474955700_ref067","article-title":"Automate, informate, and generate: affordance primitives of smart devices and the internet of things","volume-title":"Handbook of Digital Innovation"},{"issue":"1","key":"key2020042711474955700_ref068","first-page":"50","article-title":"Autonomous tools and design","volume":"62","year":"2019","journal-title":"Communications of the ACM"},{"key":"key2020042711474955700_ref069","article-title":"Face Value? Exploring the Effects of Embodiment for a Group Facilitation Agent","year":"2018"},{"issue":"3","key":"key2020042711474955700_ref070","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1089\/1094931041291295","article-title":"The online disinhibition effect","volume":"7","year":"2004","journal-title":"CyberPsychology and Behavior"},{"key":"key2020042711474955700_ref071","article-title":"Selfies and security","year":"2016"},{"key":"key2020042711474955700_ref072","first-page":"1","article-title":"\u201cRobots, AI, and the question of \u2018e-persons\u2019 - a panel at the 2017 Science in Public conference, 10-12 July 2017\u201d","volume-title":"Journal of Science Communication","year":"2017"},{"key":"key2020042711474955700_ref073","article-title":"Defense innovation board recommends AI ethical guidelines","year":"2019"},{"key":"key2020042711474955700_ref074","article-title":"Conversational agents - exploring generative mechanisms and second-hand effects of actualized technology affordances","year":"2020"},{"issue":"4","key":"key2020042711474955700_ref075","first-page":"114","article-title":"Collaborative intelligence: humans and AI are joining forces","volume":"96","year":"2018","journal-title":"Harvard Business Review"},{"issue":"1","key":"key2020042711474955700_ref076","doi-asserted-by":"crossref","first-page":"169","DOI":"10.2307\/23043494","article-title":"Product-related deception in e-commerce: a theoretical perspective","volume":"35","year":"2011","journal-title":"MIS Quarterly"},{"issue":"4","key":"key2020042711474955700_ref077","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1287\/isre.2015.0592","article-title":"Designing warning messages for detecting biased online product recommendations: an empirical investigation","volume":"26","year":"2015","journal-title":"Information Systems Research"},{"key":"key2020042711474955700_ref078","first-page":"251","article-title":"Human-robot similarity and willingness to work with a robotic co-worker","year":"2018"},{"key":"key2020042711474955700_ref079","first-page":"620","article-title":"How to design interfaces for product recommendation agents to influence the purchase of environmentally-friendly products","year":"2016"},{"issue":"1","key":"key2020042711474955700_ref080","first-page":"96","article-title":"Chatbots: an interactive technology for personalized communication and transaction","volume":"15","year":"2017","journal-title":"International Journal on WWW\/Internet"}],"container-title":["Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/INTR-12-2019-0503\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/INTR-12-2019-0503\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T21:37:26Z","timestamp":1753393046000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/intr\/article\/30\/1\/1-18\/391045"}},"subtitle":["Issues and research opportunities"],"short-title":[],"issued":{"date-parts":[[2020,2,3]]},"references-count":80,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,2,23]]}},"alternative-id":["10.1108\/INTR-12-2019-0503"],"URL":"https:\/\/doi.org\/10.1108\/intr-12-2019-0503","relation":{},"ISSN":["1066-2243"],"issn-type":[{"value":"1066-2243","type":"print"}],"subject":[],"published":{"date-parts":[[2020,2,3]]}}}