{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T16:48:22Z","timestamp":1778258902652,"version":"3.51.4"},"reference-count":54,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2023,11,15]],"date-time":"2023-11-15T00:00:00Z","timestamp":1700006400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The advantages of using mutual information to evaluate the correlation between randomness tests have recently been demonstrated. However, it has been pointed out that the high complexity of this method limits its application in batteries with a greater number of tests. The main objective of this work is to reduce the complexity of the method based on mutual information for analyzing the independence between the statistical tests of randomness. The achieved complexity reduction is estimated theoretically and verified experimentally. A variant of the original method is proposed by modifying the step in which the significant values of the mutual information are determined. The correlation between the NIST battery tests was studied, and it was concluded that the modifications to the method do not significantly affect the ability to detect correlations. Due to the efficiency of the newly proposed method, its use is recommended to analyze other batteries of tests.<\/jats:p>","DOI":"10.3390\/e25111545","type":"journal-article","created":{"date-parts":[[2023,11,15]],"date-time":"2023-11-15T10:51:37Z","timestamp":1700045497000},"page":"1545","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Complexity Reduction in Analyzing Independence between Statistical Randomness Tests Using Mutual Information"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7260-2444","authenticated-orcid":false,"given":"Jorge Augusto","family":"Karell-Albo","sequence":"first","affiliation":[{"name":"Instituto de Criptograf\u00eda, Facultad de Matem\u00e1tica y Computaci\u00f3n, Universidad de la Habana, Habana 10400, Cuba"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6104-9671","authenticated-orcid":false,"given":"Carlos Miguel","family":"Leg\u00f3n-P\u00e9rez","sequence":"additional","affiliation":[{"name":"Instituto de Criptograf\u00eda, Facultad de Matem\u00e1tica y Computaci\u00f3n, Universidad de la Habana, Habana 10400, Cuba"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2627-1912","authenticated-orcid":false,"given":"Raisa","family":"Socorro-Llanes","sequence":"additional","affiliation":[{"name":"Facultad de Ingenier\u00eda Inform\u00e1tica, Universidad Tecnol\u00f3gica de la Habana Jos\u00e9 Antonio Echeverr\u00eda (CUJAE), Habana 19390, Cuba"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0681-3833","authenticated-orcid":false,"given":"Omar","family":"Rojas","sequence":"additional","affiliation":[{"name":"Facultad de Ciencias Econ\u00f3micas y Empresariales, Universidad Panamericana, \u00c1lvaro del Portillo 49, Zapopan 45010, Jalisco, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7793-896X","authenticated-orcid":false,"given":"Guillermo","family":"Sosa-G\u00f3mez","sequence":"additional","affiliation":[{"name":"Facultad de Ciencias Econ\u00f3micas y Empresariales, Universidad Panamericana, \u00c1lvaro del Portillo 49, Zapopan 45010, Jalisco, Mexico"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,11,15]]},"reference":[{"key":"ref_1","first-page":"265","article-title":"A Hybrid Random Number Generator(HRNG)","volume":"18","author":"Skliar","year":"2011","journal-title":"Rev. De Matem\u00e1tica Teor\u00eda Apl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1007\/978-3-540-85912-3_2","article-title":"On Independence and Sensitivity of Statistical Randomness Tests","volume":"Volume 5203","author":"Turan","year":"2008","journal-title":"Proceedings of the Sequences and Their Applications-SETA 2008"},{"key":"ref_3","unstructured":"Ko\u00e7ak, O. (2016). A Unified Evaluation of Statistical Randomness Tests and Experimental Analysis of Their Relations. [Ph.D. Thesis, Middle East Technical University]."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Jajodia, S., and Lopez, J. (2008, January 6\u20138). Dismantling MIFARE Classic. Proceedings of the Computer Security\u2014ESORICS 2008, Torremolinos, Spain. Lecture Notes in Computer Science.","DOI":"10.1007\/978-3-540-88313-5"},{"key":"ref_5","first-page":"343","article-title":"All You Can Eat or Breaking a Real-World Contactless Payment System","volume":"Volume 6052","author":"Sion","year":"2010","journal-title":"Proceedings of the International Conference on Financial Cryptography and Data Security"},{"key":"ref_6","unstructured":"Sako, K., and Sarkar, P. (2013, January 1\u20135). Factoring RSA Keys from Certified Smart Cards: Coppersmith in the Wild. Proceedings of the Advances in Cryptology\u2014ASIACRYPT, Bengaluru, India. Lecture Notes in Computer Science."},{"key":"ref_7","unstructured":"Bundesamt f\u00fcr Sicherheit in der Informationstechnik (2004). Certification Report BSI-DSZ-CC-0212-2004 for Renesas AE45C1 (HD65145C1) Smartcard Integrated Circuit Version 01, Federal Office for Information Security. Technical Report."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Dunn, W.L., and Shultis, J.K. (2012). Exploring Monte Carlo Methods, Elsevier.","DOI":"10.1016\/B978-0-444-51575-9.00007-5"},{"key":"ref_9","unstructured":"Rukhin, A. (2011). Randomness through Computation, World Scientific."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Hernandez-Castro, J., and Barrero, D.F. (2017, January 5\u20138). Evolutionary Generation and Degeneration of Randomness to Assess the Indepedence of the Ent Test Battery. Proceedings of the 2017 IEEE Congress on Evolutionary Computation (CEC), Donostia, Spain.","DOI":"10.1109\/CEC.2017.7969470"},{"key":"ref_11","unstructured":"Do\u011fanaksoy, A., Ege, B., and Mu\u015f, K. (2008, January 25\u201327). Extended Results for Independence and Sensitivity of NIST Randomness Tests. Proceedings of the Information Security and Cryptography Conference, Istanbul, Turkey."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"655","DOI":"10.3906\/elk-1503-214","article-title":"Mutual Correlation of NIST Statistical Randomness Tests and Comparison of Their Sensitivities on Transformed Sequences","volume":"25","author":"Sulak","year":"2017","journal-title":"Turk. J. Elec. Eng. Comp. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1007\/978-3-030-04762-7_8","article-title":"Great Expectations: A Critique of Current Approaches to Random Number Generation Testing & Certification","volume":"Volume 11322","author":"Cremers","year":"2018","journal-title":"Proceedings of the Security Standardisation Research"},{"key":"ref_14","first-page":"1","article-title":"A systematic approach of NIST statistical tests dependencies","volume":"5","author":"Burciu","year":"2019","journal-title":"J. Electr. Eng. Electron. Control. Comput. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3673","DOI":"10.3906\/elk-1605-212","article-title":"On the Independence of Statistical Randomness Tests Included in the NIST Test Suite","volume":"25","author":"Sulak","year":"2017","journal-title":"Turk. J. Elec. Eng. Comp. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Fan, L., Chen, H., and Gao, S. (2013, January 19\u201321). A General Method to Evaluate the Correlation of Randomness Tests. Proceedings of the International Workshop on Information Security Applications, Jeju Island, Republic of Korea.","DOI":"10.1007\/978-3-319-05149-9_4"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Karell-Albo, J.A., Leg\u00f3n-P\u00e9rez, C.M., Madarro-Cap\u00f3, E.J., Rojas, O., and Sosa-G\u00f3mez, G. (2020). Measuring independence between statistical randomness tests by mutual information. Entropy, 22.","DOI":"10.3390\/e22070741"},{"key":"ref_18","first-page":"127116","article-title":"A New Approach to Analyze the Independence of Statistical Tests of Randomness","volume":"426","author":"Luengo","year":"2022","journal-title":"Appl. Math. Comput."},{"key":"ref_19","first-page":"613","article-title":"Critical Analysis of Hypothesis Tests in Federal Information Processing Standard (140-2)","volume":"24","author":"Luengo","year":"2022","journal-title":"Entropy Int. Interdiscip. J. Entropy Inf. Stud."},{"key":"ref_20","unstructured":"Cerna, M.B.L. (2023, October 01). Nuevas T\u00e9cnicas Computacionales Para La Estimaci\u00f3n de La Independencia de Los Tests de Aleatoriedad. Available online: https:\/\/docta.ucm.es\/entities\/publication\/9c972153-b581-456f-b2a3-3bb7c3c256c9."},{"key":"ref_21","unstructured":"Thomas, J.A., and Cover, T. (1991). Elements of Information Theory, John Wiley & Sons, Inc."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/S0167-9473(99)00020-1","article-title":"An Estimator of the Mutual Information Based on a Criterion for Conditional Independence","volume":"32","author":"Darbellay","year":"1999","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1080\/01621459.1989.10478751","article-title":"Relative Entropy Measures of Multivariate Dependence","volume":"84","author":"Joe","year":"1989","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2307\/1401301","article-title":"On the Foundations of Information Theory","volume":"33","author":"Renyi","year":"1965","journal-title":"Rev. Int. Stat. Inst."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Michalowicz, J.V., Nichols, J.M., and Bucholtz, F. (2013). Handbook of Differential Entropy, CRC.","DOI":"10.1201\/b15991"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1134","DOI":"10.1103\/PhysRevA.33.1134","article-title":"Independent Coordinates for Strange Attractors from Mutual Information","volume":"33","author":"Fraser","year":"1986","journal-title":"Phys. Rev. A"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1315","DOI":"10.1109\/18.761290","article-title":"Estimation of the Information by an Adaptive Partitioning of the Observation Space","volume":"45","author":"Darbellay","year":"1999","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_28","unstructured":"Silverman, B.W. (1986). Density Estimation for Statistics and Data Analysis, CRC Press."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2318","DOI":"10.1103\/PhysRevE.52.2318","article-title":"Estimation of Mutual Information Using Kernel Density Estimators","volume":"52","author":"Moon","year":"1995","journal-title":"Phys. Rev. E"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Diks, C., and Manzan, S. (2002). Tests for Serial Independence and Linearity Based on Correlation Integrals. Stud. Nonlinear Dyn. Econom., 6.","DOI":"10.2202\/1558-3708.1005"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1191","DOI":"10.1162\/089976603321780272","article-title":"Estimation of Entropy and Mutual Information","volume":"15","author":"Paninski","year":"2003","journal-title":"Neural Comput."},{"key":"ref_32","first-page":"066138","article-title":"Estimating Mutual Information","volume":"69","author":"Kraskov","year":"2004","journal-title":"Phys. Rev. E Stat. Physics Plasmas Fluids Relat. Interdiscip. Top."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Daub, C.O., Steuer, R., Selbig, J., and Kloska, S. (2004). Estimating Mutual Information Using B-spline Functions\u2014An Improved Similarity Measure for Analysing Gene Expression Data. BMC Bioinform., 5.","DOI":"10.1186\/1471-2105-5-118"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1051\/aas:1998221","article-title":"Expansions for Nearly Gaussian Distributions","volume":"130","author":"Blinnikov","year":"1998","journal-title":"Astron. Astrophys. Suppl. Ser."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"695","DOI":"10.3906\/elk-1312-90","article-title":"Comprehensive review of association estimators for the inference of gene networks","volume":"24","author":"Yavuz","year":"2016","journal-title":"Turk. J. Electr. Eng. Comput. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Contreras Rodr\u00edguez, L., Madarro-Cap\u00f3, E.J., Leg\u00f3n-P\u00e9rez, C.M., Rojas, O., and Sosa-G\u00f3mez, G.S.G. (2021). Selecting an Effective Entropy Estimator for Short Sequences of Bits and Bytes with Maximum Entropy. Entropy, 23.","DOI":"10.3390\/e23050561"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"4197","DOI":"10.1142\/S0218127409025298","article-title":"Evaluation of Mutual Information Estimators for Time Series","volume":"19","author":"Papana","year":"2009","journal-title":"Int. J. Bifurc. Chaos"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2092","DOI":"10.1080\/02664763.2020.1784853","article-title":"Equal-Bin-Width Histogram versus Equal-Bin-Count Histogram","volume":"48","author":"Sulewski","year":"2021","journal-title":"J. Appl. Stat."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1080\/01621459.1926.10502161","article-title":"The Choice of a Class Interval","volume":"21","author":"Sturges","year":"1926","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_40","first-page":"417","article-title":"Some Methods for Strengthening the Common \u03c72 Tests","volume":"10","author":"Cochran","year":"1954","journal-title":"Biom. J. Int. Biom. Soc."},{"key":"ref_41","unstructured":"Lane, D. (2023, May 13). Online Statistics Education: A Multimedia Course of Study. Available online: https:\/\/onlinestatbook.com\/."},{"key":"ref_42","first-page":"1559","article-title":"Estimation of an Unknown Distribution Density from Observations","volume":"3","author":"Cencov","year":"1962","journal-title":"Soviet Math."},{"key":"ref_43","unstructured":"Bendat, J.S., and Piersol, A.G. (1966). Measurement and Analysis of Random Data, John Wiley & Sons. [2nd ed.]."},{"key":"ref_44","unstructured":"Larson, H.J. (1975). Statistics: An Introduction, John Wiley & Sons, Inc."},{"key":"ref_45","unstructured":"Velleman, P. (1976). Interactive Computing for Exploratory Data Analysis i: Display Algorithms. Proc. Stat. Comput. Sect., 142\u2013147."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1080\/00031305.1976.10479172","article-title":"Aesthetic Frequency Classifications","volume":"30","author":"Doane","year":"1976","journal-title":"Am. Stat."},{"key":"ref_47","unstructured":"Mosteller, F., and Tukey, J.W. (1977). Addison-Wesley Series in Behavioral Science: Quantitative Methods, Reading, Mass, Addison-Wesley."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1080\/01621459.1985.10477163","article-title":"Oversmoothed Nonparametric Density Estimates","volume":"80","author":"Terrell","year":"1985","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_49","unstructured":"Ishikawa, K. (1986). Guide to Quality Control, UNIPUB\/Kraus International, White Plains."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"175","DOI":"10.3233\/IDA-2005-9204","article-title":"Optimal Bin Number for Equal Frequency Discretizations in Supervized Learning","volume":"9","author":"Boulle","year":"2005","journal-title":"Intell. Data Anal."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Zhang, Z. (2016). Statistical Implications of Turing\u2019s Formula, John Wiley & Sons, Inc.","DOI":"10.1002\/9781119237150"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1214\/aoms\/1177732360","article-title":"The Large-Sample Distribution of the Likelihood Ratio for Testing Composite Hypotheses","volume":"9","author":"Wilks","year":"1938","journal-title":"Ann. Math. Stat."},{"key":"ref_53","unstructured":"Menezes, A.J., van Oorschot, P.C., and Vanstone, S.A. (1997). Handbook of Applied Cryptography, CRC Press."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Madarro-Cap\u00f3, E.J., Leg\u00f3n-P\u00e9rez, C.M., Rojas, O., and Sosa-G\u00f3mez, G. (2021). Information theory based evaluation of the RC4 stream cipher outputs. Entropy, 23.","DOI":"10.3390\/e23070896"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/11\/1545\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:23:34Z","timestamp":1760131414000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/11\/1545"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,15]]},"references-count":54,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,11]]}},"alternative-id":["e25111545"],"URL":"https:\/\/doi.org\/10.3390\/e25111545","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,15]]}}}