{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T16:02:56Z","timestamp":1780675376059,"version":"3.54.1"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2021,5,11]],"date-time":"2021-05-11T00:00:00Z","timestamp":1620691200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Emerg. Technol. Comput. Syst."],"published-print":{"date-parts":[[2021,7,31]]},"abstract":"<jats:p>\n            Performing a comprehensive side-channel analysis evaluation of small embedded devices is a process known for its variability and complexity. In real-world experimental setups, the results are largely influenced by a huge amount of parameters, some of which are not easily adjusted without trial and error and are heavily relying on the experience of professional security analysts. In this article, we advocate the usage of an existing statistical methodology called Six Sigma (6\n            <jats:inline-formula>\n              <jats:alternatives>\n                <jats:tex-math>\n                  \n                <\/jats:tex-math>\n              <\/jats:alternatives>\n            <\/jats:inline-formula>\n            ) for side-channel analysis optimization. This well-known methodology is commonly used in other industrial fields, such as production and quality engineering, to reduce the variability of industrial processes. We propose a customized Six Sigma methodology, which allows even a less-experienced security analysis to select optimal values for the different variables that are critical for the side-channel analysis procedure. Moreover, we show how our methodology helps in improving different phases in the side-channel analysis process.\n          <\/jats:p>","DOI":"10.1145\/3446997","type":"journal-article","created":{"date-parts":[[2021,5,11]],"date-time":"2021-05-11T13:59:37Z","timestamp":1620741577000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["The Uncertainty of Side-channel Analysis: A Way to Leverage from Heuristics"],"prefix":"10.1145","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0892-3611","authenticated-orcid":false,"given":"Unai","family":"Rioja","sequence":"first","affiliation":[{"name":"Ikerlan Technology Research Centre, Spain and Digital Security Group, Radboud University Nijmegen, Nijmegen, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4665-7457","authenticated-orcid":false,"given":"Servio","family":"Paguada","sequence":"additional","affiliation":[{"name":"Ikerlan Technology Research Centre, Spain and Digital Security Group, Radboud University Nijmegen, Nijmegen, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lejla","family":"Batina","sequence":"additional","affiliation":[{"name":"Digital Security Group, Radboud University Nijmegen, Nijmegen, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5055-455X","authenticated-orcid":false,"given":"Igor","family":"Armendariz","sequence":"additional","affiliation":[{"name":"Ikerlan Technology Research Centre, Gipuzkoa, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,5,11]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Thiago Monteiro. 2019. Improve how you code: Understanding Rubber Duck Debugging. Retrieved from https:\/\/gitduck.com\/blog\/improve-how-to-code-with-rubber-duck-debugging\/.  Thiago Monteiro. 2019. Improve how you code: Understanding Rubber Duck Debugging. Retrieved from https:\/\/gitduck.com\/blog\/improve-how-to-code-with-rubber-duck-debugging\/."},{"key":"e_1_2_1_2_1","unstructured":"Federal Information Processing Standards Publication 197. 2001. Announcing the Advanced Encryption Standard (AES). Retrieved from https:\/\/nvlpubs.nist.gov\/nistpubs\/FIPS\/NIST.FIPS.197.pdf.  Federal Information Processing Standards Publication 197. 2001. Announcing the Advanced Encryption Standard (AES). Retrieved from https:\/\/nvlpubs.nist.gov\/nistpubs\/FIPS\/NIST.FIPS.197.pdf."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00145-010-9084-8"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/648255.752733"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74735-2_31"},{"key":"e_1_2_1_7_1","volume-title":"Cryptographic Hardware and Embedded Systems (CHES\u201904), Marc Joye and Jean-Jacques Quisquater (Eds.)","author":"Brier Eric","unstructured":"Eric Brier , Christophe Clavier , and Francis Olivier . 2004. Correlation power analysis with a leakage model . In Cryptographic Hardware and Embedded Systems (CHES\u201904), Marc Joye and Jean-Jacques Quisquater (Eds.) . Springer Berlin , 16\u201329. Eric Brier, Christophe Clavier, and Francis Olivier. 2004. Correlation power analysis with a leakage model. In Cryptographic Hardware and Embedded Systems (CHES\u201904), Marc Joye and Jean-Jacques Quisquater (Eds.). Springer Berlin, 16\u201329."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/648255.752740"},{"key":"e_1_2_1_9_1","volume-title":"The application of design for Six Sigma on high level smart phone development. J. Qual. 19 (1","author":"Cheng Chuen-Sheng","year":"2012","unstructured":"Chuen-Sheng Cheng , S.-C. Lee , P.-W. Chen , and K.-K. Huang . 2012. The application of design for Six Sigma on high level smart phone development. J. Qual. 19 (1 2012 ), 117\u2013136. DOI:https:\/\/doi.org\/10.6220\/joq.2012.19(2).02 10.6220\/joq.2012.19(2).02 Chuen-Sheng Cheng, S.-C. Lee, P.-W. Chen, and K.-K. Huang. 2012. The application of design for Six Sigma on high level smart phone development. J. Qual. 19 (1 2012), 117\u2013136. DOI:https:\/\/doi.org\/10.6220\/joq.2012.19(2).02"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2017.2757440"},{"key":"e_1_2_1_11_1","unstructured":"Common Criteria. 2017. Common Criteria v3.1. Release 5. Retrieved from https:\/\/www.commoncriteriaportal.org\/cc\/index.cfm?.  Common Criteria. 2017. Common Criteria v3.1. Release 5. Retrieved from https:\/\/www.commoncriteriaportal.org\/cc\/index.cfm?."},{"key":"e_1_2_1_12_1","volume-title":"International Cryptographic Module Conference","volume":"20","author":"Cooper Jeremy","year":"2013","unstructured":"Jeremy Cooper , Elke DeMulder , Gilbert Goodwill , Joshua Jaffe , Gary Kenworthy , Pankaj Rohatgi , et\u00a0al. 2013 . Test vector leakage assessment (TVLA) methodology in practice . In International Cryptographic Module Conference , Vol. 20 . Jeremy Cooper, Elke DeMulder, Gilbert Goodwill, Joshua Jaffe, Gary Kenworthy, Pankaj Rohatgi, et\u00a0al. 2013. Test vector leakage assessment (TVLA) methodology in practice. In International Cryptographic Module Conference, Vol. 20."},{"key":"e_1_2_1_13_1","volume-title":"Spagon","author":"Czitrom Veronica","year":"1997","unstructured":"Veronica Czitrom and Patrick D . Spagon . 1997 . Statistical Case Studies for Industrial Process Improvement. Society for Industrial and Applied Mathematics . DOI:https:\/\/doi.org\/10.1137\/1.9780898719765 10.1137\/1.9780898719765 Veronica Czitrom and Patrick D. Spagon. 1997. Statistical Case Studies for Industrial Process Improvement. Society for Industrial and Applied Mathematics. DOI:https:\/\/doi.org\/10.1137\/1.9780898719765"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/560131"},{"key":"e_1_2_1_15_1","volume-title":"faster, and more robust T-test based leakage detection","author":"Ding A.","unstructured":"A. Ding , C. Chen , and Thomas Eisenbarth . 2016. Simpler , faster, and more robust T-test based leakage detection . In COSADE. Springer International Publishing . A. Ding, C. Chen, and Thomas Eisenbarth. 2016. Simpler, faster, and more robust T-test based leakage detection. In COSADE. Springer International Publishing."},{"key":"e_1_2_1_16_1","volume-title":"Advances in Cryptology (EUROCRYPT\u201915)","author":"Duc Alexandre","unstructured":"Alexandre Duc , Sebastian Faust , and Fran\u00e7ois-Xavier Standaert . 2015. Making masking security proofs concrete . In Advances in Cryptology (EUROCRYPT\u201915) , Elisabeth Oswald and Marc Fischlin (Eds.). Springer Berlin , 401\u2013429. Alexandre Duc, Sebastian Faust, and Fran\u00e7ois-Xavier Standaert. 2015. Making masking security proofs concrete. In Advances in Cryptology (EUROCRYPT\u201915), Elisabeth Oswald and Marc Fischlin (Eds.). Springer Berlin, 401\u2013429."},{"key":"e_1_2_1_17_1","first-page":"140","article-title":"The Pareto principle","volume":"7","author":"Dunford Rosie","year":"2014","unstructured":"Rosie Dunford , Quanrong Su , and Ekraj Tamang . 2014 . The Pareto principle . Plym. Student Sci. 7 (2014), 140 \u2013 148 . Rosie Dunford, Quanrong Su, and Ekraj Tamang. 2014. The Pareto principle. Plym. Student Sci. 7 (2014), 140\u2013148.","journal-title":"Plym. Student Sci."},{"key":"e_1_2_1_18_1","unstructured":"EMVCo. 2001. Official EMVCo webpage. Retrieved from https:\/\/www.emvco.com\/.  EMVCo. 2001. Official EMVCo webpage. Retrieved from https:\/\/www.emvco.com\/."},{"key":"e_1_2_1_19_1","volume-title":"Mutual information analysis\u2014A universal differential side-channel attack. IACR Cryptology ePrint Archive 2007 (1","author":"Gierlichs Benedikt","year":"2007","unstructured":"Benedikt Gierlichs , Lejla Batina , and Pim Tuyls . 2007. Mutual information analysis\u2014A universal differential side-channel attack. IACR Cryptology ePrint Archive 2007 (1 2007 ), 198. Benedikt Gierlichs, Lejla Batina, and Pim Tuyls. 2007. Mutual information analysis\u2014A universal differential side-channel attack. IACR Cryptology ePrint Archive 2007 (1 2007), 198."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/11894063_2"},{"key":"e_1_2_1_21_1","volume-title":"NIST Non-invasive Attack Testing Workshop","volume":"7","author":"Goodwill Gilbert","year":"2011","unstructured":"Gilbert Goodwill , Benjamin Jun , J. Jaffe , and Pankaj Rohatgi . 2011 . A testing methodology for side-channel resistance . In NIST Non-invasive Attack Testing Workshop , Vol. 7 . 115\u2013136. Gilbert Goodwill, Benjamin Jun, J. Jaffe, and Pankaj Rohatgi. 2011. A testing methodology for side-channel resistance. In NIST Non-invasive Attack Testing Workshop, Vol. 7. 115\u2013136."},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Joseph Gordon (Ed.). 2002. Six Sigma Quality for Business and Manufacture. Elsevier Science.  Joseph Gordon (Ed.). 2002. Six Sigma Quality for Business and Manufacture. Elsevier Science.","DOI":"10.1016\/B978-044451047-1\/50008-2"},{"key":"e_1_2_1_23_1","volume-title":"NIST Non-invasive Attack Testing Workshop. Citeseer.","author":"Jaffe Josh","year":"2011","unstructured":"Josh Jaffe and Riscure Pankaj Rohatgi , Cryptography Research Inc , Marc Witteman . 2011 . Efficient side-channel testing for public key algorithms: RSA case study . In NIST Non-invasive Attack Testing Workshop. Citeseer. Josh Jaffe and Riscure Pankaj Rohatgi, Cryptography Research Inc, Marc Witteman. 2011. Efficient side-channel testing for public key algorithms: RSA case study. In NIST Non-invasive Attack Testing Workshop. Citeseer."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/2517747"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/646764.703989"},{"key":"e_1_2_1_26_1","volume-title":"SPACE\u201916","author":"Maghrebi Houssem","unstructured":"Houssem Maghrebi , Thibault Portigliatti , and Emmanuel Prouff . 2016. Breaking cryptographic implementations using deep learning techniques . In SPACE\u201916 . Springer , 3\u201326. Houssem Maghrebi, Thibault Portigliatti, and Emmanuel Prouff. 2016. Breaking cryptographic implementations using deep learning techniques. In SPACE\u201916. Springer, 3\u201326."},{"key":"e_1_2_1_27_1","volume-title":"Topics in Cryptology (CT-RSA\u201904)","author":"Mangard Stefan","unstructured":"Stefan Mangard . 2004. Hardware countermeasures against DPA\u2014A statistical analysis of their effectiveness . In Topics in Cryptology (CT-RSA\u201904) , Tatsuaki Okamoto (Ed.). Springer Berlin , 222\u2013235. Stefan Mangard. 2004. Hardware countermeasures against DPA\u2014A statistical analysis of their effectiveness. In Topics in Cryptology (CT-RSA\u201904), Tatsuaki Okamoto (Ed.). Springer Berlin, 222\u2013235."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/1208234"},{"key":"e_1_2_1_29_1","volume-title":"A comprehensive study of deep learning for side-channel analysis. Trans. Cryptogr. Hardw. Embed. Syst. 2020 (11","author":"Masure Lo\u00efc","year":"2019","unstructured":"Lo\u00efc Masure , C\u00e9cile Dumas , and Emmanuel Prouff . 2019. A comprehensive study of deep learning for side-channel analysis. Trans. Cryptogr. Hardw. Embed. Syst. 2020 (11 2019 ). DOI:https:\/\/doi.org\/10.13154\/tches.v2020.i1.348-375 10.13154\/tches.v2020.i1.348-375 Lo\u00efc Masure, C\u00e9cile Dumas, and Emmanuel Prouff. 2019. A comprehensive study of deep learning for side-channel analysis. Trans. Cryptogr. Hardw. Embed. Syst. 2020 (11 2019). DOI:https:\/\/doi.org\/10.13154\/tches.v2020.i1.348-375"},{"key":"e_1_2_1_30_1","volume-title":"Cryptographic Hardware and Embedded Systems (CHES\u201915), Tim G\u00fcneysu and Helena Handschuh (Eds.)","author":"Del Pozo Santos Merino","unstructured":"Santos Merino Del Pozo and Fran\u00e7ois-Xavier Standaert . 2015. Blind source separation from single measurements using singular spectrum analysis . In Cryptographic Hardware and Embedded Systems (CHES\u201915), Tim G\u00fcneysu and Helena Handschuh (Eds.) . Springer Berlin , 42\u201359. Santos Merino Del Pozo and Fran\u00e7ois-Xavier Standaert. 2015. Blind source separation from single measurements using singular spectrum analysis. In Cryptographic Hardware and Embedded Systems (CHES\u201915), Tim G\u00fcneysu and Helena Handschuh (Eds.). Springer Berlin, 42\u201359."},{"key":"e_1_2_1_31_1","volume-title":"Design & Analysis of Experiments","author":"Montgomery Douglas C.","unstructured":"Douglas C. Montgomery . 2019. Design & Analysis of Experiments . John Wiley & Sons, Inc. Douglas C. Montgomery. 2019. Design & Analysis of Experiments. John Wiley & Sons, Inc."},{"key":"e_1_2_1_32_1","article-title":"Leakage detection with the -test","volume":"2018","author":"Moradi Amir","year":"2018","unstructured":"Amir Moradi , Bastian Richter , Tobias Schneider , and Fran\u00e7ois-Xavier Standaert . 2018 . Leakage detection with the -test . IACR Trans. Cryptogr. Hardw. Embed. Syst. 2018 , 1 (2018). DOI:https:\/\/doi.org\/10.13154\/tches.v2018.i1.209-237 10.13154\/tches.v2018.i1.209-237 Amir Moradi, Bastian Richter, Tobias Schneider, and Fran\u00e7ois-Xavier Standaert. 2018. Leakage detection with the -test. IACR Trans. Cryptogr. Hardw. Embed. Syst. 2018, 1 (2018). DOI:https:\/\/doi.org\/10.13154\/tches.v2018.i1.209-237","journal-title":"IACR Trans. Cryptogr. Hardw. Embed. Syst."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-37288-9_15"},{"key":"e_1_2_1_34_1","volume-title":"Jaehun Kim, Annelie Heuser, Shivam Bhasin, and Axel Legay.","author":"Picek Stjepan","year":"2018","unstructured":"Stjepan Picek , Ioannis Petros Samiotis , Jaehun Kim, Annelie Heuser, Shivam Bhasin, and Axel Legay. 2018 . On the performance of convolutional neural networks for side-channel analysis. In Security, Privacy, and Applied Cryptography Engineering. Springer International Publishing , Cham, 157\u2013176. Stjepan Picek, Ioannis Petros Samiotis, Jaehun Kim, Annelie Heuser, Shivam Bhasin, and Axel Legay. 2018. On the performance of convolutional neural networks for side-channel analysis. In Security, Privacy, and Applied Cryptography Engineering. Springer International Publishing, Cham, 157\u2013176."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/1593949"},{"key":"e_1_2_1_36_1","unstructured":"PSYCTC.org. 2010. Confidence intervals for a sample (Pearson) coefficient value. Retrieved from https:\/\/www.psyctc.org\/stats\/R\/CI_correln1.html.  PSYCTC.org. 2010. Confidence intervals for a sample (Pearson) coefficient value. Retrieved from https:\/\/www.psyctc.org\/stats\/R\/CI_correln1.html."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31815-6_35"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-66787-4_19"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13389-011-0004-0"},{"key":"e_1_2_1_40_1","first-page":"359","article-title":"Failure analysis of automobile spares in a manufacturing supply chain distribution centre using Six Sigma DMAIC framework","volume":"29","author":"Srivatsa S.","year":"2018","unstructured":"S. Srivatsa Sr inivas and V. Raja Sreedharan . 2018 . Failure analysis of automobile spares in a manufacturing supply chain distribution centre using Six Sigma DMAIC framework . Int. J. Serv. Oper. Manag. 29 , 3 (2018), 359 \u2013 372 . Retrieved from https:\/\/ideas.repec.org\/a\/ids\/ijsoma\/v29y2018i3p359-372.html. S. Srivatsa Srinivas and V. Raja Sreedharan. 2018. Failure analysis of automobile spares in a manufacturing supply chain distribution centre using Six Sigma DMAIC framework. Int. J. Serv. Oper. Manag. 29, 3 (2018), 359\u2013372. Retrieved from https:\/\/ideas.repec.org\/a\/ids\/ijsoma\/v29y2018i3p359-372.html.","journal-title":"Int. J. Serv. Oper. Manag."},{"key":"e_1_2_1_41_1","volume-title":"Smart Card Research and Advanced Applications (CARDIS'18)","author":"Standaert F.","unstructured":"F. Standaert . 2018. How (not) to use Welch\u2019s T-test in side-channel security evaluations. In Smart Card Research and Advanced Applications (CARDIS'18) , B. Bilgin and J. B. Fischer (Eds.). Lecture Notes in Computer Science, vol 11389. Springer , Cham. https:\/\/doi.org\/10.1007\/978-3-030-15462-2_5 10.1007\/978-3-030-15462-2_5 F. Standaert. 2018. How (not) to use Welch\u2019s T-test in side-channel security evaluations. In Smart Card Research and Advanced Applications (CARDIS'18), B. Bilgin and J. B. Fischer (Eds.). Lecture Notes in Computer Science, vol 11389. Springer, Cham. https:\/\/doi.org\/10.1007\/978-3-030-15462-2_5"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/1598984.1598989"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.5555\/1964621.1964632"},{"key":"e_1_2_1_44_1","first-page":"505","article-title":"DL-LA: Deep learning leakage assessment: A modern roadmap for SCA evaluations","volume":"2019","author":"Wegener Felix","year":"2019","unstructured":"Felix Wegener , Thorben Moos , and Amir Moradi . 2019 . DL-LA: Deep learning leakage assessment: A modern roadmap for SCA evaluations . IACR Cryptology ePrint Archive 2019 (2019), 505 . Retrieved from https:\/\/eprint.iacr.org\/2019\/505. Felix Wegener, Thorben Moos, and Amir Moradi. 2019. DL-LA: Deep learning leakage assessment: A modern roadmap for SCA evaluations. IACR Cryptology ePrint Archive 2019 (2019), 505. Retrieved from https:\/\/eprint.iacr.org\/2019\/505.","journal-title":"IACR Cryptology ePrint Archive"},{"key":"#cr-split#-e_1_2_1_45_1.1","doi-asserted-by":"crossref","unstructured":"Carolyn Whitnall and Elisabeth Oswald. 2019. A Critical Analysis of ISO 17825 (''Testing Methods for the Mitigation of Non-invasive Attack Classes Against Cryptographic Modules''). 256-284. DOI:https:\/\/doi.org\/10.1007\/978-3-030-34618-8_9 10.1007\/978-3-030-34618-8_9","DOI":"10.1007\/978-3-030-34618-8_9"},{"key":"#cr-split#-e_1_2_1_45_1.2","doi-asserted-by":"crossref","unstructured":"Carolyn Whitnall and Elisabeth Oswald. 2019. A Critical Analysis of ISO 17825 (''Testing Methods for the Mitigation of Non-invasive Attack Classes Against Cryptographic Modules''). 256-284. DOI:https:\/\/doi.org\/10.1007\/978-3-030-34618-8_9","DOI":"10.1007\/978-3-030-34618-8_9"},{"key":"e_1_2_1_46_1","article-title":"Methodology for efficient CNN architectures in profiling attacks","volume":"2020","author":"Zaid Gabriel","year":"2019","unstructured":"Gabriel Zaid , Lilian Bossuet , Amaury Habrard , and Alexandre Venelli . 2019 . Methodology for efficient CNN architectures in profiling attacks . IACR Trans. Cryptogr. Hardw. Embed. Syst. 2020 , 1 (2019). Gabriel Zaid, Lilian Bossuet, Amaury Habrard, and Alexandre Venelli. 2019. Methodology for efficient CNN architectures in profiling attacks. IACR Trans. Cryptogr. Hardw. Embed. Syst. 2020, 1 (2019).","journal-title":"IACR Trans. Cryptogr. Hardw. Embed. Syst."}],"container-title":["ACM Journal on Emerging Technologies in Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3446997","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3446997","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:26Z","timestamp":1750195706000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3446997"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,11]]},"references-count":46,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,7,31]]}},"alternative-id":["10.1145\/3446997"],"URL":"https:\/\/doi.org\/10.1145\/3446997","relation":{},"ISSN":["1550-4832","1550-4840"],"issn-type":[{"value":"1550-4832","type":"print"},{"value":"1550-4840","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,11]]},"assertion":[{"value":"2020-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-05-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}