{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T09:36:40Z","timestamp":1780393000762,"version":"3.54.1"},"reference-count":43,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T00:00:00Z","timestamp":1631577600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSF","award":["CNS-1953740, CNS-1237265, and CNS-1518921"],"award-info":[{"award-number":["CNS-1953740, CNS-1237265, and CNS-1518921"]}]},{"name":"Cable Labs"},{"DOI":"10.13039\/100016443","name":"Amazon","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100016443","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Microsoft"},{"name":"Cisco"},{"name":"Comcast"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Internet Technol."],"published-print":{"date-parts":[[2022,2,28]]},"abstract":"<jats:p>Many Internet of Things devices have voice user interfaces. One of the most popular voice user interfaces is Amazon\u2019s Alexa, which supports more than 50,000 third-party applications (\u201cskills\u201d). We study how Alexa\u2019s integration of these skills may confuse users. Our survey of 237 participants found that users do not understand that skills are often operated by third parties, that they often confuse third-party skills with native Alexa functions, and that they are unaware of the functions that the native Alexa system supports. Surprisingly, users who interact with Alexa more frequently are more likely to conclude that a third-party skill is a native Alexa function. The potential for misunderstanding creates new security and privacy risks: attackers can develop third-party skills that operate without users\u2019 knowledge or masquerade as native Alexa functions. To mitigate this threat, we make design recommendations to help users better distinguish native functionality and third-party skills, including audio and visual indicators of native and third-party contexts, as well as a consistent design standard to help users learn what functions are and are not possible on Alexa.<\/jats:p>","DOI":"10.1145\/3446389","type":"journal-article","created":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T16:03:26Z","timestamp":1631635406000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["Alexa, Who Am I Speaking To?: Understanding Users\u2019 Ability to Identify Third-Party Apps on Amazon Alexa"],"prefix":"10.1145","volume":"22","author":[{"given":"David","family":"Major","sequence":"first","affiliation":[{"name":"Princeton University, Princeton, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Danny Yuxing","family":"Huang","sequence":"additional","affiliation":[{"name":"New York University, Brooklyn, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marshini","family":"Chetty","sequence":"additional","affiliation":[{"name":"University of Chicago, Chicago, Illinois, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nick","family":"Feamster","sequence":"additional","affiliation":[{"name":"University of Chicago, Chicago, Illinois, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,9,14]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Over a quarter of US adults now own a smart speaker, typically an Amazon Echo. Tech Crunch. Retrieved","author":"Perez Sarah","year":"2020","unstructured":"Sarah Perez . 2019. Over a quarter of US adults now own a smart speaker, typically an Amazon Echo. Tech Crunch. Retrieved February 2, 2020 from https:\/\/techcrunch.com\/2019\/03\/08\/over-a-quarter-of-u-s-adults-now-own- a-smart-speaker-typically-an-amazon-echo\/. Sarah Perez. 2019. Over a quarter of US adults now own a smart speaker, typically an Amazon Echo. Tech Crunch. Retrieved February 2, 2020 from https:\/\/techcrunch.com\/2019\/03\/08\/over-a-quarter-of-u-s-adults-now-own- a-smart-speaker-typically-an-amazon-echo\/."},{"key":"e_1_2_1_2_1","volume-title":"Retrieved","year":"2021","unstructured":"Amazon. n.d. Number of English Skills on Amazon Alexa (Internet Archive) . Retrieved July 29, 2021 from https:\/\/bit.ly\/366Z70G. Amazon. n.d. Number of English Skills on Amazon Alexa (Internet Archive). Retrieved July 29, 2021 from https:\/\/bit.ly\/366Z70G."},{"key":"e_1_2_1_3_1","volume-title":"Retrieved","year":"2019","unstructured":"Amazon. 2019 . Alexa Skills Store . Retrieved September 11, 2019 from https:\/\/www.amazon.com\/alexa-skills\/b?ie=UTF8&node=13727921011. Amazon. 2019. Alexa Skills Store. Retrieved September 11, 2019 from https:\/\/www.amazon.com\/alexa-skills\/b?ie=UTF8&node=13727921011."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170427.3188448"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274371"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.2478\/popets-2019-0068"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/3361476.3361510"},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Y. Gao Z. Pan H. Wang and G. Chen. 2018. Alexa my love: Analyzing reviews of Amazon Echo. In Proceedings of the 2018 IEEE SmartWorld Ubiquitous Intelligence Computing Advanced Trusted Computing Scalable Computing Communications Cloud Big Data Computing Internet of People and Smart City Innovation (SmartWorld\/ SCALCOM\/UIC\/ATC\/CBDCom\/IOP\/SCI\u201918). 372\u2013380. DOI:http:\/\/dx.doi.org\/10.1109\/SmartWorld.2018.00094  Y. Gao Z. Pan H. Wang and G. Chen. 2018. Alexa my love: Analyzing reviews of Amazon Echo. In Proceedings of the 2018 IEEE SmartWorld Ubiquitous Intelligence Computing Advanced Trusted Computing Scalable Computing Communications Cloud Big Data Computing Internet of People and Smart City Innovation (SmartWorld\/ SCALCOM\/UIC\/ATC\/CBDCom\/IOP\/SCI\u201918). 372\u2013380. DOI:http:\/\/dx.doi.org\/10.1109\/SmartWorld.2018.00094","DOI":"10.1109\/SmartWorld.2018.00094"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3176349.3176868"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3053246"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174214"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196772"},{"key":"e_1_2_1_13_1","volume-title":"International Journal of Human\u2013Computer Interaction 31, 4","author":"Moorthy Aarthi Easwara","year":"2015","unstructured":"Aarthi Easwara Moorthy and Kim-Phuong L. Vu. 2015. Privacy concerns for use of voice activated personal assistant in the public space . International Journal of Human\u2013Computer Interaction 31, 4 ( 2015 ), 307\u2013335. DOI:http:\/\/dx.doi.org\/10.1080\/10447318.2014.986642 Aarthi Easwara Moorthy and Kim-Phuong L. Vu. 2015. Privacy concerns for use of voice activated personal assistant in the public space. International Journal of Human\u2013Computer Interaction 31, 4 (2015), 307\u2013335. DOI:http:\/\/dx.doi.org\/10.1080\/10447318.2014.986642"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/3277203.3277207"},{"key":"e_1_2_1_15_1","unstructured":"Nan Zhang Xianghang Mi Xuan Feng XiaoFeng Wang Yuan Tian and Feng Qian. 2018. Understanding and mitigating the security risks of voice-controlled third-party skills on Amazon Alexa and Google Home. arxiv:1805.01525  Nan Zhang Xianghang Mi Xuan Feng XiaoFeng Wang Yuan Tian and Feng Qian. 2018. Understanding and mitigating the security risks of voice-controlled third-party skills on Amazon Alexa and Google Home. arxiv:1805.01525"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/2187809"},{"key":"e_1_2_1_17_1","volume-title":"Amazon Echo Has 23% Share of Smart Speakers in Use: Strategy Analytics. Retrieved","author":"XXX.","year":"2019","unstructured":"XXX. 2018. Amazon Echo Has 23% Share of Smart Speakers in Use: Strategy Analytics. Retrieved May 3, 2019 from https:\/\/news.strategyanalytics.com\/press-release\/intelligent-home\/amazo n-echo-has-23-share-smart-speakers-use-strategy-analytics. XXX. 2018. Amazon Echo Has 23% Share of Smart Speakers in Use: Strategy Analytics. Retrieved May 3, 2019 from https:\/\/news.strategyanalytics.com\/press-release\/intelligent-home\/amazo n-echo-has-23-share-smart-speakers-use-strategy-analytics."},{"key":"e_1_2_1_18_1","volume-title":"Alexa Voice Service. Retrieved","year":"2019","unstructured":"Alexa. 2019. Alexa Voice Service. Retrieved May 3, 2019 from https:\/\/developer.amazon.com\/alexa-voice-service. Alexa. 2019. Alexa Voice Service. Retrieved May 3, 2019 from https:\/\/developer.amazon.com\/alexa-voice-service."},{"key":"e_1_2_1_19_1","volume-title":"Host a Custom Skill as a Web Service. Retrieved","year":"2019","unstructured":"Alexa. 2019. Host a Custom Skill as a Web Service. Retrieved May 3, 2019 from https:\/\/developer.amazon.com\/docs\/custom-skills\/host-a-custom-skill-as- a-web-service.html. Alexa. 2019. Host a Custom Skill as a Web Service. Retrieved May 3, 2019 from https:\/\/developer.amazon.com\/docs\/custom-skills\/host-a-custom-skill-as- a-web-service.html."},{"key":"e_1_2_1_20_1","volume-title":"Understanding How Users Invoke Custom Skills. Retrieved","year":"2019","unstructured":"Alexa. 2019. Understanding How Users Invoke Custom Skills. Retrieved May 6, 2019 from https:\/\/developer.amazon.com\/docs\/custom-skills\/understanding-how-users -invoke-custom-skills.html. Alexa. 2019. Understanding How Users Invoke Custom Skills. Retrieved May 6, 2019 from https:\/\/developer.amazon.com\/docs\/custom-skills\/understanding-how-users -invoke-custom-skills.html."},{"key":"e_1_2_1_21_1","unstructured":"Amazon.com help: What do the lights on your echo device mean? [Online]. Retrieved from https:\/\/www.amazon.com\/gp\/help\/customer\/display.html?nodeId=GKLDRFT7FP4FZE56.  Amazon.com help: What do the lights on your echo device mean? [Online]. Retrieved from https:\/\/www.amazon.com\/gp\/help\/customer\/display.html?nodeId=GKLDRFT7FP4FZE56."},{"key":"e_1_2_1_22_1","unstructured":"Choose the invocation name for a custom skill | alexa skills kit. [Online]. Retrieved from https:\/\/developer.amazon.com\/en-US\/docs\/alexa\/customskills\/choose-the-invocation-name-for-a-custom-skill.html.  Choose the invocation name for a custom skill | alexa skills kit. [Online]. Retrieved from https:\/\/developer.amazon.com\/en-US\/docs\/alexa\/customskills\/choose-the-invocation-name-for-a-custom-skill.html."},{"key":"e_1_2_1_23_1","unstructured":"Amazon.com: Home wifi: Alexa skills. [Online]. Retrieved from https:\/\/voiceapp.store\/listing\/home-wifi\/.  Amazon.com: Home wifi: Alexa skills. [Online]. Retrieved from https:\/\/voiceapp.store\/listing\/home-wifi\/."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3133956.3134052"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.2478\/popets-2019-0040"},{"key":"e_1_2_1_26_1","volume-title":"Mozilla Hacks. Retrieved","author":"Nyman Robert","year":"2012","unstructured":"Robert Nyman . 2012 . Using the Fullscreen API in web browsers . Mozilla Hacks. Retrieved July 29, 2021 from https:\/\/hacks.mozilla.org\/2012\/01\/using-the-fullscreen-api-in-web-browser s. Robert Nyman. 2012. Using the Fullscreen API in web browsers. Mozilla Hacks. Retrieved July 29, 2021 from https:\/\/hacks.mozilla.org\/2012\/01\/using-the-fullscreen-api-in-web-browser s."},{"key":"e_1_2_1_27_1","volume-title":"AI. Retrieved","author":"Staff Apple Insider","year":"2017","unstructured":"Apple Insider Staff . 2017 . Proof of concept phishing attack mimics iOS popups to steal user passwords . AI. Retrieved July 29, 2021 from https:\/\/appleinsider.com\/articles\/17\/10\/10\/proof-of-concept-phishing-atta ck-mimics-ios-popups-to-steal-user-passwords. Apple Insider Staff. 2017. Proof of concept phishing attack mimics iOS popups to steal user passwords. AI. Retrieved July 29, 2021 from https:\/\/appleinsider.com\/articles\/17\/10\/10\/proof-of-concept-phishing-atta ck-mimics-ios-popups-to-steal-user-passwords."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/365153.365168"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/575201"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/3086829"},{"key":"e_1_2_1_31_1","volume-title":"Guerrero","author":"L\u00f3pez Gustavo","year":"2018","unstructured":"Gustavo L\u00f3pez , Luis Quesada , and Luis A . Guerrero . 2018 . Alexa vs. Siri vs. Cortana vs. Google Assistant : A comparison of speech-based natural user interfaces. In Advances in Human Factors and Systems Interaction, Isabel L. Nunes (Ed.). Springer International Publishing , Cham, Switzerland, 241\u2013250. Gustavo L\u00f3pez, Luis Quesada, and Luis A. Guerrero. 2018. Alexa vs. Siri vs. Cortana vs. Google Assistant: A comparison of speech-based natural user interfaces. In Advances in Human Factors and Systems Interaction, Isabel L. Nunes (Ed.). Springer International Publishing, Cham, Switzerland, 241\u2013250."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2017.3571053"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/3277203.3277207"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2019.00016"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3369807"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3412383"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 2019 IEEE Symposium on Security and Privacy (SP\u201919)","author":"Redmiles Elissa M.","unstructured":"Elissa M. Redmiles , Sean Kross , and Michelle L. Mazurek . 2019. How well do my results generalize? Comparing security and privacy survey results from MTurk, web, and telephone samples . In Proceedings of the 2019 IEEE Symposium on Security and Privacy (SP\u201919) . IEEE, Los Alamitos, CA, 227\u2013244. Elissa M. Redmiles, Sean Kross, and Michelle L. Mazurek. 2019. How well do my results generalize? Comparing security and privacy survey results from MTurk, web, and telephone samples. In Proceedings of the 2019 IEEE Symposium on Security and Privacy (SP\u201919). IEEE, Los Alamitos, CA, 227\u2013244."},{"key":"e_1_2_1_38_1","volume-title":"The Coding Manual for Qualitative Researchers","author":"Salda\u00f1na Johnny","unstructured":"Johnny Salda\u00f1na . 2013. The Coding Manual for Qualitative Researchers ( 2 nd ed.). SAGE , Los Angeles, CA . Johnny Salda\u00f1na. 2013. The Coding Manual for Qualitative Researchers (2nd ed.). SAGE, Los Angeles, CA.","edition":"2"},{"key":"e_1_2_1_39_1","volume-title":"Retrieved","author":"Alexa Amazon","year":"2019","unstructured":"Amazon Alexa . 2019 . Save Data Between Sessions . Retrieved July 29, 2021 from https:\/\/developer.amazon.com\/docs\/custom-skills\/manage-skill-session-and- session-attributes.html#save-data-between-sessions. Amazon Alexa. 2019. Save Data Between Sessions. Retrieved July 29, 2021 from https:\/\/developer.amazon.com\/docs\/custom-skills\/manage-skill-session-and- session-attributes.html#save-data-between-sessions."},{"key":"e_1_2_1_40_1","volume-title":"Retrieved","year":"2019","unstructured":"Alexa. 2019 . Alexa Conversations: Creating Natural Voice Experiences Faster . Retrieved September 14, 2019 from https:\/\/developer.amazon.com\/en-US\/alexa\/alexa-skills-kit\/alexa-convers ations. Alexa. 2019. Alexa Conversations: Creating Natural Voice Experiences Faster. Retrieved September 14, 2019 from https:\/\/developer.amazon.com\/en-US\/alexa\/alexa-skills-kit\/alexa-convers ations."},{"key":"e_1_2_1_41_1","volume-title":"Retrieved","author":"Martin Taylor","year":"2019","unstructured":"Taylor Martin . 2019 . The Complete List of Alexa Commands So Far . Retrieved September 14, 2019 from https:\/\/www.cnet.com\/how-to\/amazon-echo-the-complete-list-of-alexa-comm ands\/. Taylor Martin. 2019. The Complete List of Alexa Commands So Far. Retrieved September 14, 2019 from https:\/\/www.cnet.com\/how-to\/amazon-echo-the-complete-list-of-alexa-comm ands\/."},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the 29th USENIX Security Symposium (USENIX Security\u201920)","author":"Guo Zhixiu","year":"2020","unstructured":"Zhixiu Guo , Zijin Lin , Pan Li , and Kai Chen . 2020 . SkillExplorer: Understanding the behavior of skills in large scale . In Proceedings of the 29th USENIX Security Symposium (USENIX Security\u201920) . 2649\u20132666. Zhixiu Guo, Zijin Lin, Pan Li, and Kai Chen. 2020. SkillExplorer: Understanding the behavior of skills in large scale. In Proceedings of the 29th USENIX Security Symposium (USENIX Security\u201920). 2649\u20132666."},{"key":"e_1_2_1_43_1","volume-title":"Retrieved","author":"Labs Security Research","year":"2021","unstructured":"Security Research Labs . n.d. Smart Spies : Alexa and Google Home Expose Users to Vishing and Eavesdropping . Retrieved July 29, 2021 from https:\/\/srlabs.de\/bites\/smart-spies\/. Security Research Labs. n.d. Smart Spies: Alexa and Google Home Expose Users to Vishing and Eavesdropping. Retrieved July 29, 2021 from https:\/\/srlabs.de\/bites\/smart-spies\/."}],"container-title":["ACM Transactions on Internet Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3446389","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3446389","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3446389","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:27Z","timestamp":1750191447000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3446389"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,14]]},"references-count":43,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,2,28]]}},"alternative-id":["10.1145\/3446389"],"URL":"https:\/\/doi.org\/10.1145\/3446389","relation":{},"ISSN":["1533-5399","1557-6051"],"issn-type":[{"value":"1533-5399","type":"print"},{"value":"1557-6051","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,14]]},"assertion":[{"value":"2020-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-09-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}