{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T16:39:23Z","timestamp":1783787963983,"version":"3.55.0"},"reference-count":30,"publisher":"Wiley","license":[{"start":{"date-parts":[[2022,2,12]],"date-time":"2022-02-12T00:00:00Z","timestamp":1644624000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61972295"],"award-info":[{"award-number":["61972295"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2019010701011407"],"award-info":[{"award-number":["2019010701011407"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2018J-11"],"award-info":[{"award-number":["2018J-11"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Wuhan Science and Technology Project Application Foundation Frontier Special Project","award":["61972295"],"award-info":[{"award-number":["61972295"]}]},{"name":"Wuhan Science and Technology Project Application Foundation Frontier Special Project","award":["2019010701011407"],"award-info":[{"award-number":["2019010701011407"]}]},{"name":"Wuhan Science and Technology Project Application Foundation Frontier Special Project","award":["2018J-11"],"award-info":[{"award-number":["2018J-11"]}]},{"name":"Foundation Project of Wuhan Maritime Communication Research Institute","award":["61972295"],"award-info":[{"award-number":["61972295"]}]},{"name":"Foundation Project of Wuhan Maritime Communication Research Institute","award":["2019010701011407"],"award-info":[{"award-number":["2019010701011407"]}]},{"name":"Foundation Project of Wuhan Maritime Communication Research Institute","award":["2018J-11"],"award-info":[{"award-number":["2018J-11"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Security and Communication Networks"],"published-print":{"date-parts":[[2022,2,12]]},"abstract":"<jats:p>Since leakage detection was introduced as a popular side-channel security assessment, it has been plagued by false-positives (a.k.a. type I errors). To fix this error, the previous solutions set detection thresholds based on an assumption-based prediction of false-positive rate (FPR). However, this study points out that such a prediction (of FPR) may be inaccurate. We notice that the prediction in EuroCrypt2016 is much smaller than (approximately <jats:inline-formula>\n                     <a:math xmlns:a=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" id=\"M1\">\n                        <a:mn>1<\/a:mn>\n                        <a:mo>\/<\/a:mo>\n                        <a:mrow>\n                           <a:mn>779<\/a:mn>\n                        <\/a:mrow>\n                     <\/a:math>\n                  <\/jats:inline-formula> times) the true FPR. The gap between prediction and truth, called underpredicted false-positives (UFP), leads to severe false-positives in leakage detection. Then, we check the statistical distribution of test statistics to analyze the cause of UFP. Our analysis indicates that the overlap between cross-validation (CV) blocks gives rise to an assumption error in the distribution of the CV-based estimates of <jats:inline-formula>\n                     <c:math xmlns:c=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" id=\"M2\">\n                        <c:mi>\u03c1<\/c:mi>\n                     <\/c:math>\n                  <\/jats:inline-formula>-statistics, which is the root cause of UFP. Therefore, we tackle the UFP by eliminating the overlap between blocks. Specifically, we propose a profiling-shared validation (PSV) and utilize this validation to improve the detection of any-variate any-order leakages. Our experiments show that the PSV solves the UFP and saves more than 75% of the test time costs. In summary, this article reports a potential flaw in leakage detection and provides a complete analysis of the flaw for the first time.<\/jats:p>","DOI":"10.1155\/2022\/6904232","type":"journal-article","created":{"date-parts":[[2022,2,12]],"date-time":"2022-02-12T20:50:08Z","timestamp":1644699008000},"page":"1-13","source":"Crossref","is-referenced-by-count":2,"title":["Gap between Prediction and Truth: A Case Study of False-Positives in Leakage Detection"],"prefix":"10.1155","volume":"2022","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9461-4075","authenticated-orcid":true,"given":"Pengbo","family":"Wang","sequence":"first","affiliation":[{"name":"Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, School of Cyber Science and Engineering, Wuhan University, Wuhan 430072, China"},{"name":"State Key Laboratory of Cryptology, P.O. Box 5159, Beijing 100878, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2218-0164","authenticated-orcid":true,"given":"Ming","family":"Tang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, School of Cyber Science and Engineering, Wuhan University, Wuhan 430072, China"},{"name":"State Key Laboratory of Cryptology, P.O. Box 5159, Beijing 100878, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shoukun","family":"Xiang","sequence":"additional","affiliation":[{"name":"Wuhan Maritime Communication Research Institute, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yaru","family":"Wang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, School of Cyber Science and Engineering, Wuhan University, Wuhan 430072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Botao","family":"Liu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, School of Cyber Science and Engineering, Wuhan University, Wuhan 430072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","reference":[{"key":"1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-68697-5_9"},{"key":"2","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-48405-1_25"},{"key":"3","article-title":"The EM side\u2014channel (s)","volume-title":"International Workshop on Cryptographic Hardware and Embedded Systems","author":"D. Agrawal","year":"2002"},{"key":"4","doi-asserted-by":"publisher","DOI":"10.1007\/11545262_12"},{"key":"5","doi-asserted-by":"publisher","DOI":"10.1007\/11894063_1"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-01001-9_26"},{"key":"7","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12002-2_33"},{"key":"8","first-page":"115","article-title":"A testing methodology for side-channel resistance validation","author":"B. J. Gilbert Goodwill"},{"key":"9","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-16763-3_5"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-49890-3_10"},{"key":"11","doi-asserted-by":"publisher","DOI":"10.46586\/tches.v2018.i1.209-237"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.46586\/tches.v2019.i2.318-345"},{"key":"13","article-title":"Leakage detection with Kolmogorov-smirnov test","author":"X. Zhou","year":"2019","journal-title":"IACR Cryptol. ePrint Arch."},{"key":"14","doi-asserted-by":"publisher","DOI":"10.1155\/2021\/6614702"},{"key":"15","doi-asserted-by":"publisher","DOI":"10.46586\/tches.v2021.i3.552-598"},{"key":"16","first-page":"1117","article-title":"Confident leakage assessment\u2014a side-channel evaluation framework based on confidence intervals","author":"F. Bache"},{"key":"17","first-page":"105","article-title":"Towards sound and optimal leakage detection procedure","author":"A. A. Ding"},{"key":"18","article-title":"T\u00e9l\u00e9com ParisTech","author":"Dpacontest","year":"2021"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1007\/s13389-014-0075-9"},{"key":"20","doi-asserted-by":"publisher","DOI":"10.1002\/sec.1760"},{"key":"21","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4614-7138-7","volume-title":"An Introduction to Statistical Learning","author":"G. James","year":"2013"},{"key":"22","article-title":"Test vector leakage assessment (TVLA) methodology in practice","author":"J. Cooper"},{"key":"23","volume-title":"Introductory Mathematical Statistics: Principles and Methods","author":"J. A. Cornell","year":"1971"},{"key":"24","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v008.i18"},{"key":"25","volume-title":"The Advanced Theory of Statistics","author":"M. G. Kendall","year":"1948"},{"key":"26","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-55220-5_26"},{"key":"27","volume-title":"Mathematical Statistics and Data Analysis","author":"J. A. Rice","year":"2006"},{"issue":"Sep","key":"28","first-page":"1089","article-title":"No unbiased estimator of the variance of k-fold cross-validation","volume":"5","author":"Y. Bengio","year":"2004","journal-title":"Journal of Machine Learning Research"},{"key":"29","doi-asserted-by":"publisher","DOI":"10.1109\/tc.2009.15"},{"key":"30","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-40349-1_1"}],"container-title":["Security and Communication Networks"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/scn\/2022\/6904232.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/scn\/2022\/6904232.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/scn\/2022\/6904232.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,12]],"date-time":"2022-02-12T20:50:17Z","timestamp":1644699017000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/scn\/2022\/6904232\/"}},"subtitle":[],"editor":[{"given":"Fazlullah","family":"Khan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2022,2,12]]},"references-count":30,"alternative-id":["6904232","6904232"],"URL":"https:\/\/doi.org\/10.1155\/2022\/6904232","relation":{},"ISSN":["1939-0122","1939-0114"],"issn-type":[{"value":"1939-0122","type":"electronic"},{"value":"1939-0114","type":"print"}],"subject":[],"published":{"date-parts":[[2022,2,12]]}}}