{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T17:14:47Z","timestamp":1770743687361,"version":"3.49.0"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2020,11,8]],"date-time":"2020-11-08T00:00:00Z","timestamp":1604793600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Bavarian State Ministry of Science and the Arts in the framework of the Centre Digitisation.Bavaria"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2020,12,31]]},"abstract":"<jats:p>\n            The complex nature of intelligent systems motivates work on supporting users during interaction, for example, through explanations. However, as of yet, there is little empirical evidence in regard to specific problems users face when applying such systems in everyday situations. This article contributes a novel method and analysis to investigate such problems\n            <jats:italic>as reported by users:<\/jats:italic>\n            We analysed 45,448 reviews of four apps on the Google Play Store (Facebook, Netflix, Google Maps, and Google Assistant) with sentiment analysis and topic modelling to reveal problems during interaction that can be attributed to the apps\u2019 algorithmic decision-making. We enriched this data with users\u2019 coping and support strategies through a follow-up online survey (N = 286). In particular, we found problems and strategies related to content, algorithm, user choice, and feedback. We discuss corresponding implications for designing user support, highlighting the importance of user control and explanations of output rather than processes.\n          <\/jats:p>","DOI":"10.1145\/3370927","type":"journal-article","created":{"date-parts":[[2020,7,7]],"date-time":"2020-07-07T12:34:07Z","timestamp":1594125247000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["A Method and Analysis to Elicit User-Reported Problems in Intelligent Everyday Applications"],"prefix":"10.1145","volume":"10","author":[{"given":"Malin","family":"Eiband","sequence":"first","affiliation":[{"name":"LMU Munich, Frauenlobstra\u00dfe, Munich, Germany"}]},{"given":"Sarah Theres","family":"V\u00f6lkel","sequence":"additional","affiliation":[{"name":"LMU Munich, Frauenlobstra\u00dfe, Munich, Germany"}]},{"given":"Daniel","family":"Buschek","sequence":"additional","affiliation":[{"name":"University of Bayreuth, Universit\u00e4tsstra\u00dfe, Bayreuth, Germany"}]},{"given":"Sophia","family":"Cook","sequence":"additional","affiliation":[{"name":"LMU Munich, Frauenlobstra\u00dfe, Munich, Germany"}]},{"given":"Heinrich","family":"Hussmann","sequence":"additional","affiliation":[{"name":"LMU Munich, Frauenlobstra\u00dfe, Munich, Germany"}]}],"member":"320","published-online":{"date-parts":[[2020,11,8]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174156"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173860"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v35i4.2513"},{"key":"e_1_2_1_4_1","volume-title":"Retrieved","author":"Association for Computing Machinery US Public Policy Council (USACM).","year":"2017","unstructured":"Association for Computing Machinery US Public Policy Council (USACM). 2017 . Statement on Algorithmic Transparency and Accountability . Retrieved December 23, 2018 from https:\/\/www.acm.org\/binaries\/content\/assets\/public-policy\/2017_usacm_statement_algorithms.pdf. Association for Computing Machinery US Public Policy Council (USACM). 2017. Statement on Algorithmic Transparency and Accountability. Retrieved December 23, 2018 from https:\/\/www.acm.org\/binaries\/content\/assets\/public-policy\/2017_usacm_statement_algorithms.pdf."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300473"},{"key":"e_1_2_1_6_1","first-page":"993","article-title":"Latent dirichlet allocation","author":"Blei David M.","year":"2003","unstructured":"David M. Blei , Andrew Y. Ng , and Michael I. Jordan . 2003 . Latent dirichlet allocation . Journal of Machine Learning Research 3 , Jan (2003), 993 -- 1022 . David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent dirichlet allocation. Journal of Machine Learning Research 3, Jan (2003), 993--1022.","journal-title":"Journal of Machine Learning Research 3"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2016.1154086"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2166966.2166996"},{"key":"e_1_2_1_9_1","volume-title":"Workshop at the Crossroads: The Interaction of HCI and Systems Issues in UbiComp. 8","author":"Chalmers Matthew","year":"2003","unstructured":"Matthew Chalmers and Ian MacColl . 2003 . Seamful and seamless design in ubiquitous computing . Workshop at the Crossroads: The Interaction of HCI and Systems Issues in UbiComp. 8 (2003). Matthew Chalmers and Ian MacColl. 2003. Seamful and seamless design in ubiquitous computing. Workshop at the Crossroads: The Interaction of HCI and Systems Issues in UbiComp. 8 (2003)."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-008-9051-3"},{"key":"e_1_2_1_11_1","volume-title":"CEUR Workshop Proceedings 543","author":"Cramer Henriette","year":"2009","unstructured":"Henriette Cramer , Bob Wielinga , Satyan Ramlal , Vanessa Evers , Lloyd Rutledge , and Natalia Stash . 2009 . The effects of transparency on perceived and actual competence of a content-based recommender . CEUR Workshop Proceedings 543 (2009), 1--10. Henriette Cramer, Bob Wielinga, Satyan Ramlal, Vanessa Evers, Lloyd Rutledge, and Natalia Stash. 2009. The effects of transparency on perceived and actual competence of a content-based recommender. CEUR Workshop Proceedings 543 (2009), 1--10."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2844110"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000033"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3185517"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3172961"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858494"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702556"},{"key":"e_1_2_1_18_1","volume-title":"Retrieved","author":"Inc.","year":"2018","unstructured":"Facebook, Inc. 2018 . Facebook Reports Second Quarter 2018 Results . Retrieved December 23, 2018 from https:\/\/investor.fb.com\/investor-news\/press-release-details\/2018\/facebook-reports-second-quarter-2018-results\/default.aspx. Facebook, Inc. 2018. Facebook Reports Second Quarter 2018 Results. Retrieved December 23, 2018 from https:\/\/investor.fb.com\/investor-news\/press-release-details\/2018\/facebook-reports-second-quarter-2018-results\/default.aspx."},{"key":"e_1_2_1_19_1","volume-title":"Media Technologies: Essays on Communication, Materiality, and","author":"Gillespie Tarleton","unstructured":"Tarleton Gillespie . 2014. The relevance of algorithms . In Media Technologies: Essays on Communication, Materiality, and Society, Tarleton Gillespie , Pablo J. Boczkowski, and Kirsten A. Foot (Eds.). The MIT Press , Cambridge, MA, 167--194. DOI:https:\/\/doi.org\/10.7551\/mitpress\/9780262525374.003.0009 10.7551\/mitpress Tarleton Gillespie. 2014. The relevance of algorithms. In Media Technologies: Essays on Communication, Materiality, and Society, Tarleton Gillespie, Pablo J. Boczkowski, and Kirsten A. Foot (Eds.). The MIT Press, Cambridge, MA, 167--194. DOI:https:\/\/doi.org\/10.7551\/mitpress\/9780262525374.003.0009"},{"key":"e_1_2_1_20_1","article-title":"The Netflix recommender system: Algorithms, business value, and innovation","volume":"6","author":"Gomez-Uribe Carlos A.","year":"2015","unstructured":"Carlos A. Gomez-Uribe and Neil Hunt . 2015 . The Netflix recommender system: Algorithms, business value, and innovation . ACM Transactions on Management Information Systems (TMIS) 6 , 4, Article 13 (2015), 19 pages. DOI:https:\/\/doi.org\/10.1145\/2843948 10.1145\/2843948 Carlos A. Gomez-Uribe and Neil Hunt. 2015. The Netflix recommender system: Algorithms, business value, and innovation. ACM Transactions on Management Information Systems (TMIS) 6, 4, Article 13 (2015), 19 pages. DOI:https:\/\/doi.org\/10.1145\/2843948","journal-title":"ACM Transactions on Management Information Systems (TMIS)"},{"key":"e_1_2_1_21_1","volume-title":"Natural Language API Basics. Retrieved","year":"2018","unstructured":"Google. 2018. Natural Language API Basics. Retrieved October 3, 2018 from https:\/\/cloud.google.com\/natural-language\/docs\/basics#sentiment-analysis-values. Google. 2018. Natural Language API Basics. Retrieved October 3, 2018 from https:\/\/cloud.google.com\/natural-language\/docs\/basics#sentiment-analysis-values."},{"key":"e_1_2_1_22_1","volume-title":"Retrieved","author":"Google","year":"2019","unstructured":"Google LLC. 2019 . Google Assistant . Retrieved July 17, 2019 from https:\/\/assistant.google.com\/. Google LLC. 2019. Google Assistant. Retrieved July 17, 2019 from https:\/\/assistant.google.com\/."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/RE.2014.6912257"},{"key":"e_1_2_1_24_1","unstructured":"Gregory D. Hager Randal Bryant Eric Horvitz Maja Mataric and Vasant Honavar. 2017. Advances in Artificial Intelligence Require Progress Across All of Computer Science. Retrieved from http:\/\/cra.org\/ccc\/resources\/ccc-led-whitepapers\/.  Gregory D. Hager Randal Bryant Eric Horvitz Maja Mataric and Vasant Honavar. 2017. Advances in Artificial Intelligence Require Progress Across All of Computer Science. Retrieved from http:\/\/cra.org\/ccc\/resources\/ccc-led-whitepapers\/."},{"key":"e_1_2_1_25_1","volume-title":"CHI\u201914 Extended Abstracts on Human Factors in Computing Systems (CHI EA\u201914)","author":"Hamilton Kevin","unstructured":"Kevin Hamilton , Karrie Karahalios , Christian Sandvig , and Motahhare Eslami . 2014. A path to understanding the effects of algorithm awareness . In CHI\u201914 Extended Abstracts on Human Factors in Computing Systems (CHI EA\u201914) . ACM , New York, NY , 631--642. DOI:https:\/\/doi.org\/10.1145\/2559206.2578883 10.1145\/2559206.2578883 Kevin Hamilton, Karrie Karahalios, Christian Sandvig, and Motahhare Eslami. 2014. A path to understanding the effects of algorithm awareness. In CHI\u201914 Extended Abstracts on Human Factors in Computing Systems (CHI EA\u201914). ACM, New York, NY, 631--642. DOI:https:\/\/doi.org\/10.1145\/2559206.2578883"},{"key":"e_1_2_1_26_1","volume-title":"Updating Google Maps with Deep Learning and Street View. Retrieved","author":"Ibarz Julian","year":"2018","unstructured":"Julian Ibarz . 2017. Updating Google Maps with Deep Learning and Street View. Retrieved October 3, 2018 from https:\/\/ai.googleblog.com\/2017\/05\/updating-google-maps-with-deep-learning.html. Julian Ibarz. 2017. Updating Google Maps with Deep Learning and Street View. Retrieved October 3, 2018 from https:\/\/ai.googleblog.com\/2017\/05\/updating-google-maps-with-deep-learning.html."},{"key":"e_1_2_1_27_1","article-title":"Introduction to the transactions on interactive intelligent systems","volume":"1","author":"Jameson Anthony","year":"2011","unstructured":"Anthony Jameson and John Riedl . 2011 . Introduction to the transactions on interactive intelligent systems . ACM Transactions on Interactive Intelligent Systems (TiiS) 1 , 1, Article 1 (2011), 6 pages. DOI:https:\/\/doi.org\/10.1145\/2030365.2030366 10.1145\/2030365.2030366 Anthony Jameson and John Riedl. 2011. Introduction to the transactions on interactive intelligent systems. ACM Transactions on Interactive Intelligent Systems (TiiS) 1, 1, Article 1 (2011), 6 pages. DOI:https:\/\/doi.org\/10.1145\/2030365.2030366","journal-title":"ACM Transactions on Interactive Intelligent Systems (TiiS)"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173995"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753529"},{"key":"e_1_2_1_30_1","article-title":"Creating personalized systems that people can scrutinize and control: Drivers, principles and experience","volume":"2","author":"Kay Judy","year":"2013","unstructured":"Judy Kay and Bob Kummerfeld . 2013 . Creating personalized systems that people can scrutinize and control: Drivers, principles and experience . ACM Transactions on Interactive Intelligent Systems (TiiS) 2 , 4, Article 24 (2013), 42 pages. DOI:https:\/\/doi.org\/10.1145\/2395123.2395129 10.1145\/2395123.2395129 Judy Kay and Bob Kummerfeld. 2013. Creating personalized systems that people can scrutinize and control: Drivers, principles and experience. ACM Transactions on Interactive Intelligent Systems (TiiS) 2, 4, Article 24 (2013), 42 pages. DOI:https:\/\/doi.org\/10.1145\/2395123.2395129","journal-title":"ACM Transactions on Interactive Intelligent Systems (TiiS)"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858402"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300863"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI\u201919)","author":"Kocielnik Rafal","unstructured":"Rafal Kocielnik , Saleema Amershi , and Paul N. Bennett . 2019. Will you accept an imperfect AI?: Exploring designs for adjusting end-user expectations of ai systems . In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI\u201919) . ACM, New York, NY, Article 411, 14 pages. DOI:https:\/\/doi.org\/10.1145\/3290605.3300641 10.1145\/3290605.3300641 Rafal Kocielnik, Saleema Amershi, and Paul N. Bennett. 2019. Will you accept an imperfect AI?: Exploring designs for adjusting end-user expectations of ai systems. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI\u201919). ACM, New York, NY, Article 411, 14 pages. DOI:https:\/\/doi.org\/10.1145\/3290605.3300641"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2678025.2701399"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2013.6645235"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the 2011 International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI\u201911)","author":"Brian","year":"2037","unstructured":"Brian Y. Lim and Anind K. Dey. 2011. Design of an intelligible mobile context-aware application . In Proceedings of the 2011 International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI\u201911) . ACM, New York, NY, 157--166. DOI:https:\/\/doi.org\/10.1145\/ 2037 373.2037399 10.1145\/2037373.2037399 Brian Y. Lim and Anind K. Dey. 2011. Design of an intelligible mobile context-aware application. In Proceedings of the 2011 International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI\u201911). ACM, New York, NY, 157--166. DOI:https:\/\/doi.org\/10.1145\/2037373.2037399"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00766-016-0251-9"},{"key":"e_1_2_1_38_1","volume-title":"MALLET: A Machine Learning for Language Toolkit.","author":"McCallum Andrew Kachites","year":"2002","unstructured":"Andrew Kachites McCallum . 2002 . MALLET: A Machine Learning for Language Toolkit. Retrieved from http:\/\/mallet.cs.umass.edu. Andrew Kachites McCallum. 2002. MALLET: A Machine Learning for Language Toolkit. Retrieved from http:\/\/mallet.cs.umass.edu."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300268"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the 2010 CHI Conference on Human Factors in Computing Systems (CHI\u201910)","author":"Sean","unstructured":"Sean A. Munson and Paul Resnick. 2010. Presenting diverse political opinions: How and how much . In Proceedings of the 2010 CHI Conference on Human Factors in Computing Systems (CHI\u201910) . ACM, New York, NY, 1457--1466. DOI:https:\/\/doi.org\/10.1145\/1753326.1753543 10.1145\/1753326.1753543 Sean A. Munson and Paul Resnick. 2010. Presenting diverse political opinions: How and how much. In Proceedings of the 2010 CHI Conference on Human Factors in Computing Systems (CHI\u201910). ACM, New York, NY, 1457--1466. DOI:https:\/\/doi.org\/10.1145\/1753326.1753543"},{"key":"e_1_2_1_41_1","volume-title":"Explainable Smart Systems Workshop at the 24th International Conference on Intelligent User Interfaces (IUI\u201919)","author":"Nguyen An T.","unstructured":"An T. Nguyen , Matthew Lease , and Byron C. Wallace . 2019. Mash: Software tools for developing interactive and transparent machine learning systems . In Explainable Smart Systems Workshop at the 24th International Conference on Intelligent User Interfaces (IUI\u201919) . An T. Nguyen, Matthew Lease, and Byron C. Wallace. 2019. Mash: Software tools for developing interactive and transparent machine learning systems. In Explainable Smart Systems Workshop at the 24th International Conference on Intelligent User Interfaces (IUI\u201919)."},{"key":"e_1_2_1_42_1","unstructured":"Christi Olson and Kelli Kemery. 2019. Voice Report: From Answers to Action: Customer Adoption of Voice Technology and Digital Assistants. Technical Report. https:\/\/advertiseonbing-blob.azureedge.net\/blob\/bingads\/media\/insight\/whitepapers\/2019\/04%20apr\/voice-report\/bingads_2019_voicereport.pdf.  Christi Olson and Kelli Kemery. 2019. Voice Report: From Answers to Action: Customer Adoption of Voice Technology and Digital Assistants. Technical Report. https:\/\/advertiseonbing-blob.azureedge.net\/blob\/bingads\/media\/insight\/whitepapers\/2019\/04%20apr\/voice-report\/bingads_2019_voicereport.pdf."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1111449.1111475"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173677"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702174"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_2_1_47_1","volume-title":"Recommender systems: Introduction and challenges","author":"Ricci Francesco","unstructured":"Francesco Ricci , Lior Rokach , and Bracha Shapira . 2015. Recommender systems: Introduction and challenges . In Recommender Systems Handbook, Francesco Ricci, Lior Rokach, and Bracha Shapira (Eds.). Springer , Boston, MA , 1--34. DOI:https:\/\/doi.org\/10.1007\/978-1-4899-7637-6_1 10.1007\/978-1-4899-7637-6_1 Francesco Ricci, Lior Rokach, and Bracha Shapira. 2015. Recommender systems: Introduction and challenges. In Recommender Systems Handbook, Francesco Ricci, Lior Rokach, and Bracha Shapira (Eds.). Springer, Boston, MA, 1--34. DOI:https:\/\/doi.org\/10.1007\/978-1-4899-7637-6_1"},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the 26th Annual Workshop of the Psychology of Programming Interest Group. Psychology of Programming Interest Group","author":"Sarkar Advait","year":"2015","unstructured":"Advait Sarkar . 2015 . Confidence, command, complexity: Metamodels for structured interaction with machine intelligence . In Proceedings of the 26th Annual Workshop of the Psychology of Programming Interest Group. Psychology of Programming Interest Group , Bournemouth, UK, 23--36. Advait Sarkar. 2015. Confidence, command, complexity: Metamodels for structured interaction with machine intelligence. In Proceedings of the 26th Annual Workshop of the Psychology of Programming Interest Group. Psychology of Programming Interest Group, Bournemouth, UK, 23--36."},{"key":"e_1_2_1_49_1","volume-title":"Scrutable user models and personalised item recommendation in mobile lifestyle applications","author":"Wasinger Rainer","unstructured":"Rainer Wasinger , James Wallbank , Luiz Pizzato , Judy Kay , Bob Kummerfeld , Matthias B\u00f6hmer , and Antonio Kr\u00fcger . 2013. Scrutable user models and personalised item recommendation in mobile lifestyle applications . In User Modeling, Adaptation, and Personalization, Sandra Carberry, Stephan Weibelzahl, Alessandro Micarelli, and Giovanni Semeraro (Eds.). Springer , Berlin , 77--88. Rainer Wasinger, James Wallbank, Luiz Pizzato, Judy Kay, Bob Kummerfeld, Matthias B\u00f6hmer, and Antonio Kr\u00fcger. 2013. Scrutable user models and personalised item recommendation in mobile lifestyle applications. In User Modeling, Adaptation, and Personalization, Sandra Carberry, Stephan Weibelzahl, Alessandro Micarelli, and Giovanni Semeraro (Eds.). Springer, Berlin, 77--88."},{"key":"e_1_2_1_50_1","volume-title":"Communication 8 Society 20, 1","author":"Willson Michele","year":"2017","unstructured":"Michele Willson . 2017. Algorithms (and the) everyday. Information , Communication 8 Society 20, 1 ( 2017 ), 137--150. DOI:https:\/\/doi.org\/10.1080\/1369118X.2016.1200645 10.1080\/1369118X.2016.1200645 Michele Willson. 2017. Algorithms (and the) everyday. Information, Communication 8 Society 20, 1 (2017), 137--150. DOI:https:\/\/doi.org\/10.1080\/1369118X.2016.1200645"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3370927","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3370927","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:23:36Z","timestamp":1750202616000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3370927"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,8]]},"references-count":50,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,12,31]]}},"alternative-id":["10.1145\/3370927"],"URL":"https:\/\/doi.org\/10.1145\/3370927","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,8]]},"assertion":[{"value":"2019-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-11-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}