{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T05:25:33Z","timestamp":1790227533576,"version":"4.1.0"},"reference-count":31,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2021,10,6]],"date-time":"2021-10-06T00:00:00Z","timestamp":1633478400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006245","name":"Ministry of Science and Technology, Israel","doi-asserted-by":"publisher","award":["N\/a"],"award-info":[{"award-number":["N\/a"]}],"id":[{"id":"10.13039\/501100006245","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Smart home assistants, which enable users to control home appliances and can be used for holding entertaining conversations, have become an inseparable part of many people\u2019s homes. Recently, there have been many attempts to allow end-users to teach a home assistant new commands, responses, and rules, which can then be shared with a larger community. However, allowing end-users to teach an agent new responses, which are shared with a large community, opens the gate to malicious users, who can teach the agent inappropriate responses in order to promote their own business, products, or political views. In this paper, we present a platform that enables users to collaboratively teach a smart home assistant (or chatbot) responses using natural language. We present a method of collectively detecting malicious users and using the commands taught by the malicious users to further mitigate activity of future malicious users. We ran an experiment with 192 subjects and show the effectiveness of our platform.<\/jats:p>","DOI":"10.3390\/s21196641","type":"journal-article","created":{"date-parts":[[2021,10,10]],"date-time":"2021-10-10T21:37:49Z","timestamp":1633901869000},"page":"6641","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["A Safe Collaborative Chatbot for Smart Home Assistants"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7568-2195","authenticated-orcid":false,"given":"Merav","family":"Chkroun","sequence":"first","affiliation":[{"name":"Computer Science Department, Ariel University, Ariel 40700, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5057-1309","authenticated-orcid":false,"given":"Amos","family":"Azaria","sequence":"additional","affiliation":[{"name":"Computer Science Department, Ariel University, Ariel 40700, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,10,6]]},"reference":[{"key":"ref_1","unstructured":"Wood, L. (2021, September 15). Global Smart Speakers Markets Report 2021: Amazon Alexa, Google Assistant, Siri, Cortana, Others-Market Is Expected to Reach $17.85 Billion in 2025 at a CAGR of 26%. Available online: https:\/\/www.globenewswire.com\/en\/news-release\/2021\/05\/24\/2234471\/28124\/en\/Global-Smart-Speakers-Markets-Report-2021-Amazon-Alexa-Google-Assistant-Siri-Cortana-Others-Market-is-Expected-to-Reach-17-85-Billion-in-2025-at-a-CAGR-of-26.html."},{"key":"ref_2","unstructured":"Jain, A. (2021, September 15). Smart Speaker Market to Grow at 21% CAGR during 2020\u20132025. Available online: https:\/\/www.counterpointresearch.com\/smart-speaker-drivers\/."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1080\/08839514.2019.1603784","article-title":"A survey of user-centred approaches for smart home transfer learning and new user home automation adaptation","volume":"33","author":"Ali","year":"2019","journal-title":"Appl. Artif. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Azaria, A., Krishnamurthy, J., and Mitchell, T.M. (2016). Instructable Intelligent Personal Agent, AAAI.","DOI":"10.1609\/aaai.v30i1.10357"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Li, T.J.J., Azaria, A., and Myers, B.A. (2017). SUGILITE: Creating Multimodal Smartphone Automation by Demonstration, ACM. CHI\u201917.","DOI":"10.1145\/3025453.3025483"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1145\/365153.365168","article-title":"ELIZA\u2014A computer program for the study of natural language communication between man and machine","volume":"9","author":"Weizenbaum","year":"1966","journal-title":"Commun. Acm"},{"key":"ref_7","unstructured":"Weizenbaum, J. (2021, August 26). Computer Power and Human Reason: From Judgment to Calculation. Available online: https:\/\/psycnet.apa.org\/record\/1976-11270-000."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Spierling, U. (2008). \u2019Killer Phrases\u2019: Design Steps for a Game with Digital Role-Playing Agents. Transactions on Edutainment I, Springer.","DOI":"10.1007\/978-3-540-69744-2_13"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Azaria, A., and Hong, J. (2016). Recommender Systems with Personality, RecSys.","DOI":"10.1145\/2959100.2959138"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Cui, L., Huang, S., Wei, F., Tan, C., Duan, C., and Zhou, M. (2017, January 16). Superagent: A customer service chatbot for e-commerce websites. Proceedings of the ACL 2017, System Demonstrations, Vancouver, BC, Canada.","DOI":"10.18653\/v1\/P17-4017"},{"key":"ref_11","unstructured":"Mauldin, M.L. (1994). Chatterbots, Tinymuds, and the Turing Test: Entering the Loebner Prize Competition, AAAI."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1093\/mind\/LIX.236.433","article-title":"Computing Machinery and Intelligence","volume":"59","author":"Turing","year":"1950","journal-title":"Mind"},{"key":"ref_13","unstructured":"Farber, M. (2016). Amazon\u2019s \u2018Alexa Prize\u2019 Will Give College Students up to $2.5 M to Create A Socialbot, Furtune."},{"key":"ref_14","unstructured":"Ram, A., Prasad, R., Khatri, C., Venkatesh, A., Gabriel, R., Liu, Q., Nunn, J., Hedayatnia, B., Cheng, M., and Nagar, A. (2018). Conversational ai: The science behind the alexa prize. arXiv."},{"key":"ref_15","unstructured":"Wallace, R. (2003). The Elements of AIML Style, Alice AI Foundation."},{"key":"ref_16","unstructured":"Huang, J., Zhou, M., and Yang, D. (2007). Extracting Chatbot Knowledge from Online Discussion Forums, IJCAI. Available online: https:\/\/www.aaai.org\/Papers\/IJCAI\/2007\/IJCAI07-066.pdf."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhang, S., Dinan, E., Urbanek, J., Szlam, A., Kiela, D., and Weston, J. (2018). Personalizing dialogue agents: I have a dog, do you have pets too?. arXiv.","DOI":"10.18653\/v1\/P18-1205"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Xu, J., Szlam, A., and Weston, J. (2021). Beyond Goldfish Memory: Long-Term Open-Domain Conversation. arXiv.","DOI":"10.18653\/v1\/2022.acl-long.356"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1038\/438281a","article-title":"Wisdom of the Crowd","volume":"438","author":"Giles","year":"2005","journal-title":"Nature"},{"key":"ref_20","unstructured":"Mestrallet, B., and Nguyen, T. (2000). Introducing the eXo Platform, The ServerSide.com."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Barowy, D.W., Berger, E.D., Goldstein, D.G., and Suri, S. (2017). VoxPL: Programming with the Wisdom of the Crowd, ACM. CHI.","DOI":"10.1145\/3025453.3026025"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1596","DOI":"10.1080\/10447318.2018.1557972","article-title":"Lia: A virtual assistant that can be taught new commands by speech","volume":"35","author":"Chkroun","year":"2019","journal-title":"Int. J.-Hum.-Comput. Interact."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Stefanidi, E., Foukarakis, M., Arampatzis, D., Korozi, M., Leonidis, A., and Antona, M. (2019). ParlAmI: A multimodal approach for programming intelligent environments. Technologies, 7.","DOI":"10.3390\/technologies7010011"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Huang, T.H.K., Azaria, A., and Bigham, J.P. (2016). Instructablecrowd: Creating If-Then Rules via Conversations with the Crowd, ACM. CHI (Extended Abstracts).","DOI":"10.1145\/2851581.2892502"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Arabshahi, F., Lee, J., Gawarecki, M., Mazaitis, K., Azaria, A., and Mitchell, T. (2020). Conversational neuro-symbolic commonsense reasoning. arXiv.","DOI":"10.1609\/aaai.v35i6.16623"},{"key":"ref_26","first-page":"17","article-title":"Automation, Algorithms, and Politics|Talking to Bots: Symbiotic Agency and the Case of Tay","volume":"10","author":"Neff","year":"2016","journal-title":"Int. J. Commun."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1109\/MC.2016.183","article-title":"The DARPA Twitter bot challenge","volume":"49","author":"Subrahmanian","year":"2016","journal-title":"Computer"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Cer, D., Yang, Y., Kong, S.y., Hua, N., Limtiaco, N., John, R.S., Constant, N., Guajardo-C\u00e9spedes, M., Yuan, S., and Tar, C. (2018). Universal sentence encoder. arXiv.","DOI":"10.18653\/v1\/D18-2029"},{"key":"ref_29","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_30","unstructured":"Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1017\/S1930297500002205","article-title":"Running experiments on amazon mechanical turk","volume":"5","author":"Paolacci","year":"2010","journal-title":"Judgm. Decis. Mak."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/19\/6641\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:09:59Z","timestamp":1760166599000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/19\/6641"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,6]]},"references-count":31,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2021,10]]}},"alternative-id":["s21196641"],"URL":"https:\/\/doi.org\/10.3390\/s21196641","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,6]]}}}