{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,14]],"date-time":"2026-09-14T00:02:17Z","timestamp":1789344137673,"version":"build-2803163510"},"reference-count":42,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T00:00:00Z","timestamp":1750118400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100017580","name":"RNP","doi-asserted-by":"publisher","award":["01245.020548\/2021-07"],"award-info":[{"award-number":["01245.020548\/2021-07"]}],"id":[{"id":"10.13039\/100017580","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100017580","name":"RNP","doi-asserted-by":"publisher","award":["052\/2023"],"award-info":[{"award-number":["052\/2023"]}],"id":[{"id":"10.13039\/100017580","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100017580","name":"RNP","doi-asserted-by":"publisher","award":["2022\/09319-9"],"award-info":[{"award-number":["2022\/09319-9"]}],"id":[{"id":"10.13039\/100017580","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100017580","name":"RNP","doi-asserted-by":"publisher","award":["302589\/2021-0"],"award-info":[{"award-number":["302589\/2021-0"]}],"id":[{"id":"10.13039\/100017580","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100018907","name":"EMBRAPII-Inatel Competence Center on 5G and 6G Networks","doi-asserted-by":"publisher","award":["01245.020548\/2021-07"],"award-info":[{"award-number":["01245.020548\/2021-07"]}],"id":[{"id":"10.13039\/501100018907","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100018907","name":"EMBRAPII-Inatel Competence Center on 5G and 6G Networks","doi-asserted-by":"publisher","award":["052\/2023"],"award-info":[{"award-number":["052\/2023"]}],"id":[{"id":"10.13039\/501100018907","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100018907","name":"EMBRAPII-Inatel Competence Center on 5G and 6G Networks","doi-asserted-by":"publisher","award":["2022\/09319-9"],"award-info":[{"award-number":["2022\/09319-9"]}],"id":[{"id":"10.13039\/501100018907","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100018907","name":"EMBRAPII-Inatel Competence Center on 5G and 6G Networks","doi-asserted-by":"publisher","award":["302589\/2021-0"],"award-info":[{"award-number":["302589\/2021-0"]}],"id":[{"id":"10.13039\/501100018907","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001807","name":"FAPESP","doi-asserted-by":"publisher","award":["01245.020548\/2021-07"],"award-info":[{"award-number":["01245.020548\/2021-07"]}],"id":[{"id":"10.13039\/501100001807","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001807","name":"FAPESP","doi-asserted-by":"publisher","award":["052\/2023"],"award-info":[{"award-number":["052\/2023"]}],"id":[{"id":"10.13039\/501100001807","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001807","name":"FAPESP","doi-asserted-by":"publisher","award":["2022\/09319-9"],"award-info":[{"award-number":["2022\/09319-9"]}],"id":[{"id":"10.13039\/501100001807","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001807","name":"FAPESP","doi-asserted-by":"publisher","award":["302589\/2021-0"],"award-info":[{"award-number":["302589\/2021-0"]}],"id":[{"id":"10.13039\/501100001807","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003593","name":"CNPq","doi-asserted-by":"publisher","award":["01245.020548\/2021-07"],"award-info":[{"award-number":["01245.020548\/2021-07"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003593","name":"CNPq","doi-asserted-by":"publisher","award":["052\/2023"],"award-info":[{"award-number":["052\/2023"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003593","name":"CNPq","doi-asserted-by":"publisher","award":["2022\/09319-9"],"award-info":[{"award-number":["2022\/09319-9"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003593","name":"CNPq","doi-asserted-by":"publisher","award":["302589\/2021-0"],"award-info":[{"award-number":["302589\/2021-0"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper presents a survey of performance metrics applicable to spectrum sensing and spectrum hole geolocation within the context of dynamic spectrum access (DSA) in cognitive radio networks. While grounded in binary hypothesis testing, the review emphasizes metrics specialized for sensing reliability, interference risk, spatial accuracy, and network efficiency. The work also highlights trade-offs among metrics and provides guidelines for their practical application. A key contribution of this work is to provide researchers and practitioners with a comprehensive set of evaluation tools, extending well beyond the applicability of the conventional probabilities of detection and false alarm.<\/jats:p>","DOI":"10.3390\/s25123770","type":"journal-article","created":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T03:37:07Z","timestamp":1750131427000},"page":"3770","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["A Survey of Performance Metrics for Spectrum Sensing and Spectrum Hole Geolocation for Wireless Spectrum Access"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1304-792X","authenticated-orcid":false,"given":"Dayan Adionel","family":"Guimar\u00e3es","sequence":"first","affiliation":[{"name":"National Institute of Telecommunications (Inatel), Santa Rita do Sapuca\u00ed 37536-001, MG, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2127","DOI":"10.1016\/j.comnet.2006.05.001","article-title":"NeXt generation\/dynamic spectrum access\/cognitive radio wireless networks: A survey","volume":"50","author":"Akyildiz","year":"2006","journal-title":"Comput. Netw."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1109\/SURV.2009.090109","article-title":"A survey of spectrum sensing algorithms for cognitive radio applications","volume":"11","author":"Yucek","year":"2009","journal-title":"IEEE Commun. Surveys Tuts."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"381465","DOI":"10.1155\/2010\/381465","article-title":"A Review on Spectrum Sensing for Cognitive Radio: Challenges and Solutions","volume":"2010","author":"Zeng","year":"2010","journal-title":"Eurasip J. Adv. Signal Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.phycom.2010.12.003","article-title":"Cooperative Spectrum Sensing in Cognitive Radio Networks: A Survey","volume":"4","author":"Akyildiz","year":"2011","journal-title":"Phys. Comm."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/MWC.2013.6507397","article-title":"Wideband spectrum sensing for cognitive radio networks: A survey","volume":"20","author":"Sun","year":"2013","journal-title":"IEEE Wirel. Commun."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Salahdine, F. (2017). Spectrum sensing techniques for cognitive radio networks. arXiv.","DOI":"10.1016\/j.phycom.2016.05.002"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Arjoune, Y., and Kaabouch, N. (2019). A Comprehensive Survey on Spectrum Sensing in Cognitive Radio Networks: Recent Advances, New Challenges, and Future Research Directions. Sensors, 19.","DOI":"10.3390\/s19010126"},{"key":"ref_8","unstructured":"Ahmad, B.I. (2020). A survey of wideband spectrum sensing algorithms for cognitive radio networks and sub-Nyquist approaches. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Nasser, A., Al Haj Hassan, H., Abou Chaaya, J., Mansour, A., and Yao, K.C. (2021). Spectrum Sensing for Cognitive Radio: Recent Advances and Future Challenge. Sensors, 21.","DOI":"10.3390\/s21072408"},{"key":"ref_10","first-page":"10","article-title":"Spectrum Sensing: A Tutorial","volume":"37","year":"2022","journal-title":"J. Commun. Inf. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1007\/s11235-023-01079-1","article-title":"A review of spectrum sensing in modern cognitive radio networks","volume":"85","author":"Muzaffar","year":"2023","journal-title":"Telecommun. Syst."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Guimar\u00e3es, D.A., Pereira, E.J.T., Alberti, A.M., and Moreira, J.V. (2021). Design Guidelines for Database-Driven Internet of Things-Enabled Dynamic Spectrum Access. Sensors, 21.","DOI":"10.3390\/s21093194"},{"key":"ref_13","unstructured":"Wald, A. (1950). Statistical Decision Functions, John Wiley and Sons."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Berger, J.O. (1985). Statistical Decision Theory and Bayesian Analysis, Springer.","DOI":"10.1007\/978-1-4757-4286-2"},{"key":"ref_15","unstructured":"Blackwell, D. (August, January 31). Comparison of experiments. Proceedings of the Second Berkeley Symposium on Mathematical Statistics and Probability, Berkeley, CA, USA."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Helstrom, C.W. (1968). Statistical Theory of Signal Detection, Pergamon Press. [2nd ed.].","DOI":"10.1016\/B978-0-08-013265-5.50016-1"},{"key":"ref_17","unstructured":"Melsa, J.L., and Cohn, D.L. (1978). Decision and Estimation Theory, McGraw-Hill."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Poor, H.V. (1994). An Introduction to Signal Detection and Estimation, Springer. [5th ed.].","DOI":"10.1007\/978-1-4757-2341-0"},{"key":"ref_19","unstructured":"Kay, S.M. (1998). Fundamentals of Statistical Signal Processing: Volume II\u2014Detection Theory, Prentice Hall PTR."},{"key":"ref_20","first-page":"289","article-title":"On the problem of the most efficient tests of statistical hypotheses","volume":"231","author":"Neyman","year":"1933","journal-title":"Philos. Trans. R. Soc. Lond. Ser. Contain. Pap. Math. Phys. Character"},{"key":"ref_21","unstructured":"Lehmann, E.L., and Romano, J.P. (2005). Testing Statistical Hypotheses, Springer Science & Business Media. [3rd ed.]. Springer Texts in Statistics."},{"key":"ref_22","unstructured":"Casella, G., and Berger, R.L. (2002). Statistical Inference, Duxbury\/Thomson Learning. [2nd ed.]."},{"key":"ref_23","first-page":"112","article-title":"Testing a Point Null Hypothesis: The Irreconcilability of p-values and Evidence","volume":"82","author":"Berger","year":"1987","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_24","unstructured":"Berger, J.O., and Wolpert, R.L. (1988). The Likelihood Principle: A Review, Some Extensions, and Some Implications for Statistical Inference. Foundations and Philosophy of Statistical Inference, University of Western Ontario."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1080\/01621459.1995.10476572","article-title":"Bayes factors","volume":"90","author":"Kass","year":"1995","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_26","unstructured":"Robert, C.P. (2007). The Bayesian Choice: From Decision-Theoretic Foundations to Computational Implementation, Springer Science & Business Media. [2nd ed.]."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Axell, E., and Larsson, E.G. (2009, January 19\u201324). A Bayesian approach to spectrum sensing, denoising and anomaly detection. Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, Taipei, Taiwan.","DOI":"10.1109\/ICASSP.2009.4960088"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1326","DOI":"10.1109\/TWC.2008.060869","article-title":"Sensing-throughput tradeoff for cognitive radio networks","volume":"7","author":"Liang","year":"2008","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1016\/j.patrec.2005.10.010","article-title":"An introduction to ROC analysis","volume":"27","author":"Fawcett","year":"2006","journal-title":"Pattern Recognit. Lett."},{"key":"ref_30","first-page":"37","article-title":"Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation","volume":"2","author":"Powers","year":"2011","journal-title":"J. Mach. Learn. Technol."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Martin, A., Doddington, G., Kamm, T., Ordowski, M., and Przybocki, M. (1997, January 22\u201325). The DET curve in assessment of detection task performance. Proceedings of the 5th European Conference on Speech Communication and Technology (Eurospeech 1997), Rhodes, Greece.","DOI":"10.21437\/Eurospeech.1997-504"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"4709","DOI":"10.1109\/JSEN.2022.3142197","article-title":"Optimization of Fusion Center Parameters with Threshold Selection in Multiple Antenna and Censoring-Based Cognitive Radio Network","volume":"22","author":"Kumar","year":"2022","journal-title":"IEEE Sens. J."},{"key":"ref_33","unstructured":"Schlesinger, R.J. (2011). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1093\/bioinformatics\/16.5.412","article-title":"Assessing the accuracy of prediction algorithms for classification: An overview","volume":"16","author":"Baldi","year":"2000","journal-title":"Bioinformatics"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Fisher, R.A. (1992). Statistical Methods for Research Workers. Breakthroughs in Statistics: Methodology and Distribution, Springer.","DOI":"10.1007\/978-1-4612-4380-9_6"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1198\/0003130031856","article-title":"P Values: What They Are and What They Are Not","volume":"57","author":"Hubbard","year":"2003","journal-title":"Am. Stat."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1109\/2.940014","article-title":"Location systems for ubiquitous computing","volume":"34","author":"Hightower","year":"2001","journal-title":"Computer"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"79","DOI":"10.3354\/cr030079","article-title":"Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance","volume":"30","author":"Willmott","year":"2005","journal-title":"Clim. Res."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"64199","DOI":"10.1109\/ACCESS.2025.3560213","article-title":"Spectrum Hole Geolocation for Database-Driven IoT-Enabled Dynamic Spectrum Access","volume":"13","year":"2025","journal-title":"IEEE Access"},{"key":"ref_40","first-page":"406","article-title":"Interference-aware spectrum sensing mechanisms in cognitive radio networks","volume":"40","author":"Zhang","year":"2014","journal-title":"Comput. Electr. Eng."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Chen, S., Shen, B., Wang, X., and Yoo, S.J. (2020). Geo-Location Information Aided Spectrum Sensing in Cellular Cognitive Radio Networks. Sensors, 20.","DOI":"10.3390\/s20010213"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2137","DOI":"10.1109\/TSP.2003.814469","article-title":"Relative location estimation in wireless sensor networks","volume":"51","author":"Patwari","year":"2003","journal-title":"IEEE Trans. Signal Process."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/25\/12\/3770\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:53:17Z","timestamp":1760032397000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/25\/12\/3770"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,17]]},"references-count":42,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2025,6]]}},"alternative-id":["s25123770"],"URL":"https:\/\/doi.org\/10.3390\/s25123770","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,17]]}}}